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(54) Title: INTELLIGENT COMPUTER SYSTEM 

(57) Abstract 

An intelligent 
computer system (180) 
is capable of real time 
learning, inference and 
updating of user profiles 
and trends to facilitate 
on-line, real-time 
recommendations or 
answer queries related 
to the user, referred to 
as "personalization", 
and may be added to, or 
integrated with, any of 
a variety of distributed 
computer systems (102, 
104, 106. 108) to add 
dynam ic personal ization 
capability thereto. The 
intelligent computer 
system ( 1 80) distributes 
it processes across the 
system as processors 
become available and as 
a function of the loads 
across the system. The 
intelligent computer system 
(180) includes a business 
command center (230) for 
generating and maintaining 

enterprise specific rules, which may be entered by a non-technical enteprise user. The system also includes a core (210) that serves as 
an operating system and includes functionality to evaluate which rules should be applied to a consumer and his session. An artificial 
intelligence system includes a machine learning system for generating and updating Bayesian models, using off-line and on-line processes, 
which are used by its inference system to make intelligent recommendations related to the user. 
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INTELLIGENT COMPUTER SYSTEM 

Cross References to Related AppUcations 

This application claims the benefit of priority from U.S. Provisional Application Serial 
Number 60/134,105, entitled INTELUGENT E-COMMERCE DISTRIBUTED COMPUTER 
SYSTEM, fded May 14, 1999, incorporated herein by reference. 

Field of the Invention 

The invention relates generally to distributed computer systems accessible by a phirality 
of users. More specifically, the present invention relates to intelligent distributed computer 
systems that make reconunendations or answer queries related to users (or virtual sessions that 
represent users either online or offline) as a function of what the system learns related to those 
users. 

Background of the Invention 
To an irereasmg degree, whether it is on the World Wide Web (the Web) or on other 
networks, network-based computer systems seek to go beyond the static, pre-scripted, or 
predetermined presentation of information to computer users. As an exanq>le, some systems 
now attempt to provide secondary or ancillary information, such as_marketing information, to a 
user (e.g., a consumers engaged in e-commerce). wherein this secondary information is 
unsolicited. It is simply provided (in response to an event) in addition to the providing of the 
primary information sought by the user. In other instances, a system will attempt to determine 
and provide the primary information that the system deems relevant or optimal for the user. 
Still, in other instances, a system may attempt to provide information that is not directly 
presented to a user, but is in response to an event related to a user (or some other system 
activity). In order to determine what information to present or supply (whether primary, 
secondary, or characterized in some other way) in response to an event, some systems attempt 
to "learn" something about the user, and then selectively provide information as a result of a 
prediction based on what the system has learned or knows - sometimes referred to as 
"personaUzation". Systems that attempt to accomplish this vary, and so to does their 
effectiveness. 

One approach to providing learning is to use collaborative filtering techniques, which 
employ various pattern matching algorithms and based on several heuristic metrics compute the 
"closeness" of a selected user's profile to other similar users. Collaborative filtering is a 
supervised learning approach. User profiles are constructed during a training phase where the 

1 
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user rates selected items, e.g., movies, with a score in a supervised manner. Such supervised 
training approaches are time consuming and can pose an inconvenience for the user. Generally, 
collaborative filtering approaches can be viewed as learning by discovering clusters of similar 
user profiles and predicting the response for a selected user based on the cluster to which it 
5 belongs. Clustering is the most basic way of discovering interesting relationships between 
attributes (of profiles). For instance, discovering that high scores for certain movies are 
correlated with low scores of a selected movie. 

Such techniques base their predictions or classification of the selected user using the 
profiles of similar users. In this respect, collaborative filtering is a basic form of case-based 

10 learning. It is based on algorithms that were developed in the 1960's and 1970's, specifically, 
the "weighted nearest-neighbor" algorithm and the "k-nearest neighbor" algorithm. These are 
non-parametric methods that rely on stored data for prediction. Because these approaches do 
not develop models of any sort, they require storing in memory of all the data cases in order to 
make predictions. In addition to high memory costs, significant computations are required at 

15 prediction time since the pattern similarity con4>utations are done at recommendation time, 
rather than in advance. This consumption of system resources may undesirably limit the 
prediction response times. ^ ^ 

Also, collaborative filtering approaches, and case-based learning systems in general, 
suffer from data over-fitting, which often leads to greater generalization and thus, lower 

20 predictive accuracy. Metrics used to measure closeness by such approaches suffer from 
needing all attributes for computing the similarity score. As a result, the distance between 
neighboring user profiles can often be dominated by the large number of irrelevant attributes, 
which can have a devastating effect on the accuracy of prediction. This is the well-known 
"curse of dimensionality** problem of non-parametric estimation and classification methods, 

25 Solutions to overcome this problem are heuristic-based and have little or no theoretical backing 
and hence are not failsafe, which is a critical for adaptive learning systems. 

A different approach for making user-related predictions is to use neiural networks. 
Neural networks are parametric models used to approximate multi-variable real valued 
mappings or functions. They can be used to learn probability ftinctions. At a micro-level 

30 neural networks are composed of nodes which are graphically interconnected, with a moderate 
degree of approximation ability. On a macro-level, however, neural networks are not well 
suited for making predictions in a highly dynamic real-time environment. 

2 
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Neural networks are like black-boxes, wherein an input layer and an output layer must 
be defined a priori to learning. After learning, only this single mapping can be used for 
inferences. The strengths between the internal nodes (also known as the hidden layers) which 
are learned by the neural networks are where the information lies. However, there is no easy 
5 way of interpreting this information other than requesting an output for a given input. 

Furthermore, neural networks cannot utilize available prior knowledge in addition to the input 
data. That is, a neural network is static with respect to time. If at some later stage new 
variables are added or deleted to the data then one needs to re-learn the neural network with 
these changed domain. This means that previously learned information will be lost. 

10 Neural networks in some instances can learn incrementally, but using a heuristic 

approach as opposed to sound probability-based updating, which con^}romises the eventual 
results. However, since neural networks can not learn with partial incomplete data, they 
generally can not do "clustering" (or unsupervised learning). That is, multi-layered feed- 
forward neural networks cannot do clustering because they require complete data (this mode of 

15 learning is known as supervised learning). 

For the most part, systems for making recommendations that are based on neural 
network technology use learning algorithms that are first generation (i.e.71980's) machine 
learning algorithms. Although neural networks have strong predictive and estimation 
capabilities utilizing their inherent non-linear structure, the algorithms with which they learn 

20 are too slow for dynamic settings such as the ones encountered in today's distributed computer 
systems, e.g., on-line e-conmierce systems. They require learning from batch data, which 
means they need to scan through each data case numerous times before converging to the 
optimal solution. As such, they do not scale efficientiy with respect to the size of large, 
changing data sets. Also, neural networks are very hard to scale (if at all possible) mainly due 

25 to their black-box nature. For example, one cannot break a traditional single neural network 
into two networks, which limits the usefulness in a dynamic distributed computer architecture, 
where such scalability, if available, can be advantageous. 

The implication of collaborative filtering and/or neural networks to distributed, real- 
time computer systems comes with limitations. As a result, there is need for an intelligent, 

30 robust, scalable distributed intelligent computer system capable of learning and updating user 
profiles based on partial and changing data to facilitate on-line, real-time personalized 
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recommendations to such a user or supply dynamic and accurate predictions (answers to query) 
about him. 

Summary of the Invention 

The present invention is an intelligence system capable of learning trends and profiles 
5 related to a user based on, at least in part, the user's interaction with the system and possibly 
some domain related information or events to facilitate on-line, real-time production and 
communication of predictions and/or reconmiendations related to the user. That is, the 
intelligence system is characterized as having automated distributed intelligence (ADI), and is 
added to an enterprise computer system to add intelligence and personalization thereto, 
10 creating an intelligent enterprise system. Due to the intelligence system, the intelligent 

enterprise system has substantially no down-time, operates in real-time, and is structured to 
have unencimibered scalability, through the use of standardized and platform independent 
software entities and the ability of the intelligence system to nionitor and redistribute its load 
dynamically. 

15 The term "enterprise" is used generically to refer to any entity, organization or 

combination thereof having a computer system (i.e., the enterprise computer system). As one 
exanq)le, an enterprise may be a vendor of products and/or services ei^aged in e-commerce, 
wherein the access to the intelligent enterprise system may be controlled, as in a private 
network, or open, as in a publicly accessible e-commerce Web site. The intelligent enterprise 

20 system may be distributed over any of a variety of commonly known networks, such as a local 
area network (LAN), wide area network (WAN), world wide web (the "Web"), intranet, 
extranet, Internet, private network, or some combination thereof. In such a case, the 
intelligent enterprise system may include one or more servers and databases that may be 
accessed by multiple users simultaneously over a network by wired and/or wireless devices 

25 (e.g., personal computers, personal digital assistants, cellular telephones, and so on). 

TTie enterprise computer system may take any of a variety of forms. For example, the 
enterprise computer system may be an application (e.g., a word processing application) 
running on a computer that includes an interface to the intelligence system for gaining a 
personalization capability. In another instance, the enterprise computer system may be an e- 

30 mail system having an interface with the intelligence system. In such a case, the e-mail system 
may include servers and databases and may link to an intelligence system having its own set of 
servers and databases, or the two systems may share servers and databases. In yet another 
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example, the enterprise system may be a video system wherein personalization from the 
intelligence system influences the video content presented to the user of the (combined) 
intelligent enterprise system. In another instance, the enterprise system may be a web 
application running in a browser with its backend running at a web server. The web 
5 application will link to the intelligence system. 

The intelligence system is preferably implemented like a client - server architecture, 
having a set of server-side software modules and possibly a client-side software module (i.e., 
client module). The software modules of the present invention are, largely, implemented in 
accordance with object oriented design methodologies, but those skilled in the art will 
10 appreciate that other design methods may also be used to practice the present invention. The 
intelligence system preferably includes (or has access to) at least one wired or wireless 
intelligence system server (or computer) to host the intelligence system server-side software, 
along with at least one associated database. The client module may be hosted on any of a 
variety of types of wired or wireless electronic devices, such as a computer, server, or other 
15 device. Furthermore, the client module and server-side software may be hosted on the same 
platform, and with or without an enterprise application. That is, the distinction between the 
server-side software and client module of the intelligence system is primarily fimctional and 
logical, rather than physical. 

The client module provides an interface between the enterprise application (e.g., e- 
20 mail, word processor, and so on) and the personalization fimctionality of the server-side. As 
an exanq)le the client module may be hosted on a front-end Web server, along with an 
enterprise Web-based application and the server-side software may be hosted on a back-end 
intelligence system server. However, generally the front-end server could be a Web server, an 
plication server, or a wired or wireless communication server, as examples, or any other 
25 system, server, or device that seeks to take advantage of the personalization offered by 
intelligence system of the present invention. Furthermore, the front-end server may be 
integrated into the same platform as the back-end server, as discussed above. 

The server-side software includes a business conmiand center, a core module, an 
artificial intelligence (AI) module, and a set of administrative tools. The administrative tools 
30 inchide a business object developer for automated creation of business (i.e., enterprise) 

objects, which embody enterprise specific rules. The business command center may be run on 
the intelligence system (e.g., back-end) server and use the same database. In any event, the 
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business command center provides logic for an enterprise, non-technical user to generate and 
maintain enterprise specific rules (as objects). ITiese rules are related to the goals, tasks, and 
processes necessary to carry out the enterprise's objectives for the system. For example, if the 
enterprise were an on-line food distributor, the rules may relate to enterprise product offerings, 
5 to shopping cart abandonment, and so on. 

For the most part, the business command center implements standard browser-based 
functionality and "wizards" to allow ease of use by enterprise users. Rules may contain a 
variety of components, depending on the application of the intelligent enterprise system. In an 
e-commerce context, for example, the rules may include a "time frame" component indicating 

10 when the rule to be applied and a "situation" component that provides dynamic information 
about the current state of the session. Additionally, a "profile" component provides static 
information about the user and a "result" con^x)nent indicates the nature of the system's 
response as a function of the previous components. The business command center is also 
configured to generate a variety of reports about the system, based on data it collects, that are 

15 useful to enterprise. 

The core module aixl AI module are hosted and run on the intelligence system (e.g., 
back-end) server. The core module serves as an "operating system" to the intelligence system 
and provides centralized administration and processing functions. For example, the core 
module includes a messaging facility and offers dynamic views of available computer 

20 resources. Using a highly distributed architecture, plug-ins, load balancing, messaging, and 
events, the core module continually ensures maximimi utilization of system resources and 
retains only those objects that relate to the active sessions. The core also includes a rule 
evaluator that evaluates information generated by an external event (e.g., a consumer purchase) 
according to the business rules established by the enterprise using the business command 

25 center. 

The AI module provides for the real-time creation, maintenance and application of 
Bayesian models, which are used to make personalized recommendations and to infer answers 
for various queries. The Bayesian models are created and maintained using on-line and off- 
line processes as a function of previous and current user responses and the general state of the 
30 intelligent enterprise system. The Bayesian models and rules are applied to generate intelligent 
responses to user inputs, including providing to a user information (e.g., recommendations) 
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regarding a second subject matter that is related to a first subject matter being queried by the 
user. 

The AI module, is the "brain" (or AI engine) of the intelligence system, and makes 
real-time recommendations based on user behavior models, continuously updating them with 
5 new information. The AI module, more than any other component, is what transforms a 
standard enterprise site into a dynamic learning and inference center. The AI module creates 
and employs intelligent virtual agents that are capable of automatically learning, utilizing and 
sharing learned knowledge to serve the client. The intelligence system's robust, scalable and 
distributed server architecture allows multiple virtual agents, learning independently, to form a 

10 unified intelligence entity, which acts as a single distributed "virtual brain". 

Learning scalability enables the intelligence system (and, therefore, the intelligent enterprise 
system) to deal with the exponential growth of data and to learn large data sets rapidly. 
Learning takes place incrementally using off-line and on-line learning algorithms, which 
provide an expedient approach to dealing with enormous amounts of data. The weights and 

IS structure of models are updated in real-time, as soon as a new piece of data arrives. These 
incremental, real-time updates enable learning from massive databases or dynamic data without 
needing to access all the data at once or repetitively. Incremental learning also gives the 
intelligent enterprise system the ability to learn in a dynamic network environment, where 
information constantly changes. 

20 User behavior models are implemented as Bayesian network models. Unlike other 

learning models (e.g., collaborative learning and neural networks), the Bayesian network 
models can work with incomplete data cases and levels of uncertainty. Once deterministic or 
probabilistic evidence has been obtained, the probability distribution for an attribute or 
combination of attributes can then be determined dynamically, in real-time. These user 

25 behavior models are reusable and can be combined to form new models, saving on both data 
resources and learning power. The model building process constructs attributes, defines their 
values and then gathers Uiem into models according to logical relationships. These models are 
then mter-linked, based on their statistical coupling. In addition to profile attributes, models 
include enterprise subject matter categories and subcategories, such as products/services 

30 categories. 

Bayesian Mtwork models built off-line and tailored by the intelligence system are 
customized for the enterprise's application, within the context of the intelligent enterprise 
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system. Off-line learning involves running several intelligent programs with several input data 
files, resulting in a set of models. Each model is an object file, in the preferred embodiment. 
Generally, a model includes variables and probability connections between those variables, 
which may be expressed in tables. 
5 The models are updated during normal system operation to reflect knowledge gained 

through on-line learning. As user-related events occur, they are logged into a database. At 
preset intervals, the intelligent enterprise system opens the database and puts the information 
gathered into data files. The data files are continuously updated as new events occur. On-line 
learning processes the files, updating the values in the models' probability tables. This action 
10 permits an enterprise site to learn quickly and accurately about the trends and patterns of user 
behavior and activity. 

The AI module is comprised of two main parts, a machine learning system (MLS) and 
an inference system (IS). The MLS automatically creates Bayesian Network Models based on 
consumers' past data. These models are then used by the IS as on-line intelligent resources. 

IS All of the intelligent operations preformed by the AI module can be obtained from these 

Bayesian models such as prediction, classification, and maximum expected utility optimization. 

Both of the MLS and IS are structured using parallel distributed^Java object-oriented 
code, allowing advantage to be taken of the distributed application server architecture. With 
parallel distribution, the processes of machine learning (using MLS) and inference (using IS) 

20 are scalable. This implies that for making inferences, the number of on-line sessions that 
require intelligent resources is scalable, while for machine learning the nimiber of Bayesian 
network models is scalable with the number of computers (or servers). 

Unlike collaborative filtering, the use of Bayesian Model networks is not a supervised 
learning ^roach, wherein user profiles are constructed during a training phase where the user 

25 rates selected items, e.g., movies, with a score in a supervised manner. In contrast, the 
Bayesian Model-based learning algorithms of the present invention can incorporate both 
mpervised and unsupervised forms of learning. Through statistically based incremental 
learning algorithms, learning can take place even with partially incomplete data. User profiles 
containii^ dynamic information such as on-line browsing behavior are formed in an 

30 unsupervised manner without burdening users with questionnaires. 

Unlike neural networks, Bayesian model networks are by no means black-boxes. 
Every node, or attribute, has a meaning and its value may be queried. A Bayesian model 



wo 00/70481 PCT/USOO/13360 



network, in its whole, represents a joint probability distribution over the attributes of the 
domain where the functional form is depicted via its structure and probabilities. The learned 
structure depicts usefiil information in terms of inter-dependencies amongst these attributes. 
For instance, the fact that one Bayesian model attribute is linked to another attribute implies 
5 that there is a statistically significant (based on the data) relationship between the two 
variables. Moreover, no prior input-output mapping needs to be defined at the start of 
learning. Any attribute(s) may serve as an input or output at any particular query time. For 
this reason, in a dynamic environment where some of the input information may be missing, 
Bayesian model networks provide benefits over neural networks. The implementation of 
10 Bayesian model networks in the present invention causes the system to accumulate available 
observations (or evidence) and then compound this evidence in a statistically sound manner, 
and produce the best (in a probabilistic sense) output or recommendation. Additionally, a 
Bayesian model network can incrementally change both its structure and its probabilities based 
on a new domain and on new data. New attributes can be added and old ones can be deleted 
15 with minor loss of probabilistic interdependency information. 

Brief Description of the Drawings 
The foregoing aiKl other objects of this invention, the various feamres thereof, as weD 
as the invention itself, may be more fully understood fi-om the following description, when 
read together with the accompanying drawings, which include: 
20 Figure 1 is a representative computer architecture using the intelligent enterprise 

system, in accordance with the present invention; 

Figure 2 is a program architecture for the intelligence system of Figure 1; 
Figure 3 is a representative graphical user interface of the business command center of 
the system of Figure 2; 

25 Figure 4 is a flowchart depicting the process of rule evaluation in accordance with the 

present invention; 

Figure 5 is a block diagram of an artificial intelligence module, as part of the intelligent 
enterprise system of the present invention; 

Figures 6A and 6B are examples of a representative product database file and portions 
30 of a corresponding representative serial file, respectively, used by the machine learning system 
of the AI module of Figure 5; 
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Figures 7A and 7B show examples of logical and topological linking models, 
respectively, of the IS and MLS of Figure 5; 

Figure 8 is a representative hyperlink file generated by the MLS of Figure 5; 
Figure 9 is an example of a serial session data file generated and used by the MLS of 
5 Figure 5; 

Figure 10 is an object-oriented depiction of a DRV model, used by the MLS of Figure 

5; 

Figure 1 1 is a table depicting the on-line learning modules of the MLS of Figure 5; 
Figures 12A and 12B are block diagrams of an architecture of the MLS of Figure 5; 
10 Figures 13A and 13B provide a table depicting the MLS components and their 

interactions; 

Figure 14 is a table depicting messaging objects used by the MLS, in accordance with 
the present invention; 

Figures 15A-15C provide a table of the components of the IS of Figure 5 and their 
15 interactions; 

Figure 16 is a table depicting messaging objects used by the IS, in accordance with the 
present invention; 

Figure 17 is a representative block diagram of the IS of Figure 5; 
Figure 18 is an example of a Bayesian network model, in accordance with the present 
20 invention; 

Figure 19 is an example of a Bayesian model m accordance with the present invention; 
Figure 20 is an example of a category change event file generated and used by the IS of 
Figure 5; 

Figures 21 A-12E are samples of QRC™ agent structures of various APIs supported by 
25 the IS; . 

Figure 22 is a sample recommended list returned by an IS inference agent; and 

Figures 23-26 depict various absorptions techniques of evidence among models. 

For the most part, and as will be apparent when referring to the figures, when an item 
is used unchanged in more than one figure, it is identified by the same alphanumeric reference 
30 indicator in all figures. 
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Detailed Description of the Preferred Embodiments 

The present invention is an intelligence system capable of real-time inference and 
learning, and updating of user profiles and trends to facilitate on-line, real-time 
recommendations or answer queries related to the user, referred to as "personalization". As 
5 will be appreciated by those skilled in the art, the intelligent computer system may be added to, 
or integrated with, any of a variety of enterprise computer systems to add dynamic 
personalization capability thereto, resulting in an intelligent enterprise system. As examples, 
the enterprise system may be an application (e.g., a word processor, or e-mail personalization 
server), a network-based application with a presentation device (like a video tour on a kiosk 

10 that is personalized), or an e-commerce system. An intelligent enterprise system in accordance 
with the present invention may include at least three characteristics. First, the intelligent 
enterprise system automatically develops Bayesian models and uses them to generate intelligent 
responses to system events. Second, the intelligent e- enterprise system accesses data and 
responds to events throughout the system. Third, the intelligent e- enterprise system 

IS processes, analyzes, and applies data according to rules defined by an enterprise user (i.e., 
enterprise rules). 

Generally, an enterprise computer system be any of a variety of systems and may 
include or be accessible by a network, such as, for example, a LAN, a WAN, an intranet, an 
extranet, a private network, the Internet, or the World Wide Web (the "Web"), or some 

20 combination thereof. Representatives of the enterprise which configure the system for a 
particular enterprise's needs are referred to as ''enterprise users" and may include, for 
exanq)le, non-technical sales and marketing staff. Meanwhile, any of a variety of types of 
entities may generates and/or receive events to and from the intelligence system. Such other 
types of entities may include an e-commerce consumer searching for at least one primary 

25 product or service, a non e-conmierce user (e.g, , a cellular telephone user) searching for 
information, or a virtual entity (e.g., an application process or system seeking information). 
Dq)ending on the configuration of the intelligent enterprise system, and the context of the 
enterprise conq)uter system, the intelligent enterprise system may support events related to a 
variety of types of entities. 

30 In the preferred embodiment, for illustrative purposes, the intelligence system is added 

to an e-commerce system of an enterprise to add, among other things, intelligence thereto, 
resulting in an intelligent e-commerce system. As an e-commerce context example, when a 
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consumer seeks a primary product, the intelligent e-commerce system may provide 
recommendations related to one or more secondary products or services, or predict the answer 
for a query about the consumer that could result in a dynamic site change (like offering an 
incentive). A secondary product or service is one not directly searched by the consumer^ and 
5 may or may not be related to the primary product or service that was searched by the 

consumer. For example, if the consumer searched the intelligent e-commerce system for bread 
as a primary product, a secondary (related) product may be a certain cheese from a certain 
maker or supplier, but another (unrelated) secondary product may be a particular automobile. 
The particular secondary products or services offered or recommended are a result of the 

10 intelligence provided by the intelligent computer system, as it continually updates consumer 
profiles and applies probabilistic models relating to the products and services sought by the 
consumer. However, predictions and recommendations are not confined to the secondary 
products (i.e., information). The intelligence system can make predictions and 
recommendations regarding and user related information (i.e., primary, secondary, or 

15 characterized in some other way). Furthermore, the predictions aiKi reconmiendations need 
not relate (directly) to a user's request for information. Rather, such predictions and requests 
are made in response to events generated and somehow related to said user: 

In the illustrative embodiment of the present invention, the intelligent enteiprise system 
is implemented on a distributed computer architecture 100, as shown in Figure 1. In such an 

20 architecture, consiuners, or other types of users, may access the intelligent enterprise system 
180 via any of a variety of known means and with any of a variety of known wired or wireless 
devices. For example, a software application (or system) 101 may access the intelligent 
enterprise system 180 by accessing an application server 110 via a network, represented by 
network cloud 118. As another example, such devices include a personal computer 102, a 

25 laptop computer 104, a.personal digital assistant 106, which are shown in Figiure 1 as 

accessing a Web server 152 via the Internet and World Wide Web (the Web), represented by 
cloud 120. Any of these devices may also include an application (like application 101) that 
access server 162 via the Internet and Web 120 and server 152. As yet another example, a 
user can access the intelligent enterprise system 180 using a typical telephone or a cellular 

30 telephone, which are shown accessing telephone server 1 14 via a telephone network, 
represented as network cloud 122. In each case, server 110, 152, and 114 access an 
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intelligence system server 162 via a wired or wireless means. All separation is logical and in 
theory 162 and 152 could run on the same computer. 

The intelligent enterprise system 180 includes the intelligence system integrated with 
the enterprise (e.g., e-commerce) system, each of which may include one or more servers and 
5 associated databases. In some configurations, the intelligence and enterprise systems may 
share servers and databases. In the configuration of Figure 1, application server 110, Web 
server 152, and/or telephone server 114 (as examples) may be front-end servers, through 
which entities access the intelligent system 180. One or more intelligence system (e.g., back- 
end) servers and databases (e.g., server 162 and database 163) service requests or events 

10 related to activity by entities interacting with the intelligent enterprise system 180, and 

received via one of the front-end servers. A database server 142 (or another relevant server or 
system) may be linked to the intelligent system server 162 locally via a LAN or remotely via a 
WAN as uMlicated by link 126, as examples. Note that database server 142, being a general 
site DB server, could be also connected to 110, 152, 114. 

15 Figure 2 shows a representative architecture for the intelligent enterprise system 180. 

As mentioned previously, in the illustrative embodiment, the intelligence system 200 integrates 
with an e-commerce solution, tying into an e-commerce Web server 152 to obtain real-time 
mformation related consumer 1 10 click-stream behavior or other site information, as well as 
tying into existing database information (e.g., database 143), which may include information 

20 such as consumer demographics and buying behavior. In the preferred embodiment, the Web 
server 152 hosts an intelligence system 200 client module (the "client") 154. Client 154 
interacts with intelligence system server 162, which hosts various intelligence system program 
modules, including a core module 210, an artificial intelligence (AI) module 220 and a 
business command center (BCC) module 230. 

25 Preferably, an enterprise user 112 creates and updates business rules using the business 

command center module 230 and the rules are stored in the intelligence system database 163 
and published (i.e., made available) to the intelligence system server 162. Thereafter, 
consumer 110 accesses the enterprise's e-commerce Web site through the Web server 152 to 
interact with the intelligent e-commerce system IBO. Beyond consumer activity, the 

30 intelligence system 200 may also be responsive to events generated by other (non-consxmier) 
entities. In response to consumer activity, the client 154 sends related events to and receives 
results (e.g., recommendations) from the intelligence system server 162. Client 154 can be 
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deployed in any of a variety of known manners, for example, using ActiveX, Servlets or 
Sockets, depending on the system tools and platform. When using sockets, the client 154 is 
actually nonexistent and the e-commerce system communicates directly with 162. As the 
consumer 110 interacts with the system 180, the core 210, i.e., the intelligence system's 
5 "operating system", "listens" for occurrences of selected events resulting from the consumer's 
click-stream activity. 

Usmg a rule evaluator, which is a component of core 210, an event is sent to all active 
rules to determine which rules are relevant for the given consumer 1 10. The rule evaluator 
calls on AI module 220, as needed, to determine how to apply each rule for the given 

10 consumer. In addition to click-stream data, the AI module 220 can utilize operational and 
historical databases 143 for specific consumer/product data. Following rule evaluation, core 
210 sends a resulting recommendation for personalized products, services or other content, as 
examples, to client 154. In turn, client 154 conmiunicates the recommendation to Web server 
152, which in turn changes the Web page and passes a new one to consumer 110. In the 

15 background, core 210 executes basic functions such as load balancing, rule creation and 
messaging. The core 210 reads and updates data, including rules and configuration 
information, which are stored as XML files in the intelligence systeiii^database 163. 

The intelligence system 200 (integrated) components combine to offer an enterprise a 
conq)rehensive, scalable and customizable on-line personalization tool, including the five 

20 conqx)nents: business command center 230 , intelligence system server 162 (the actual 

personalization server), intelligence system client 154, intelligence system database 163, and a 
set of administration tools 240. Working together, these components enable the enterprise to 
create and test specific e-conunerce initiatives, interact with and learn from consumers and 
their preferences, as well as analyze and report results. 

25 1. Business Command Center (BCC) 230 

The business command center 230 allows an enterprise user to create, pre-test, update, 
and evaluate the intact of their intended e-conunerce initiatives using their own defined 
business rules. Preferably, this interaction takes place via a standard Web browser (e.g., 
Internet Explorer by Microsoft Corporation of Redmond, WA) and "wizards", in an easy to 

30 use windowing environment, without requiring support from technical persoimel (e.g., 
conq>uter progranamers or information technology personnel). Among other things, the 
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business command center 230 provides in-depth reports and analyses offering enterprise users 
112 the critical information necessary for making effective decisions in real-time mode. 

As an example, a business command center main screen 300 is shown in Figure 3, 
which may be used for building and editing enterprise defined rules. Rules are built using 
5 business objects created using a business object developer (BOD), discussed with respect to the 
administration tools 240 below. A business object provides a tangible expression for (or 
embodies) a rule, wherein a rule has four components (or levels) in the preferred embodiment, 
including time frame 302, situation 304, profile 306 and result 308, shown in Figure 3. The 
latter 3 components are constructed of Boolean expressions composed of operations. Those 
10 operations could be of several types, for example, they may be: 

1) (Queries from a database (SQL or Stored Procedure operation type); 

2) (Juery about the session history - events that happened in the site and sent from the 
client; 

3) Any Java written operation that the user desired to do something of his choice; or 
15 4) AI operation - that normally involves an inference request from the system. 

Building e;q)ressions for each of the four components of a rule may be acconq>lished 
with the use of a wizard, designed for non-technical users. The time frame level 302 defines 
the exact times when the business rule will be activated by the system 180 (e.g., a first quarter 
promotion (Jan 1 - Mar 31)). The situation level 304 defines the dynamic information relating 

20 to the current state of the system (e.g. , "The user has clicked to purchase cookies. "). The 
situation 304 triggers the evaluation of the business rule by the rule evaluator (discussed in 
Section 2.1 below). The profile 306 provides static information about the user (e.g., "This 
user is age 50".; "This user bought milk last month."). This can come from the operational or 
historical data stored in database 143, or it may be inferred by AI module 220. The result 

25 conq)onent is the response to the user (e.g., "This month we have a sale on milk,"), which 
delivers personalized recommendations of products, services or content. 

Of critical inq)ortance for improvement, optimization, and/or adaptability of the 
intelligent e-commerce system 180 by an enterprise is an ability to track the effectiveness of 
every business rule that affects its consumers. Accordingly, the business command center 220 

30 includes a reporting capability that permits an enterprise to track the performance (i.e. , 

consumer response) of their initiatives and provides a powerful analysis tool in the process. 
Using the knowledge gained through this automated analysis, intelligence system 200 can 
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recommend refinements to various rules to improve the intelligent computer system's 180 
performance. Ongoing analysis, refinement and changing business needs lead naturally to the 
creation of new rules, in turn providing better marketing intelligence for the enterprise. As 
indicated in the hierarchy portion 320 of the screen shown in Figure 3, in the preferred 
5 embodiment, the intelligence system 200 reporting module tracks several critical types of 
information and provides corresponding reports 328, including: business rule reports, 
intelligence system performance reports, and site behavior reports. This performance 
monitoring and the corresponding reports allow enterprise users to make improvements 
through the creation of new business rules and the modification of existing business rules. 
10 First, for each business rule or set of rules (e.g.. Holiday initiatives) the intelligence 

system 200 tracks the impact on consumer behavior over time. Using key metrics, such as 
page views, click-throughs, and purchase patterns, intelligence system 200 enables the 
enterprise user to determine which rules are most effective, and to analyze rule effectiveness 
across consumer profiles, time periods, products and categories. Second, beyond specific 
15 rules, enterprise users also need to know what kind of inq>act the intelligence system 200 has 
on their overall on-line business performance. Therefore, intelligence system 200 tracks its 
own effectiveness across all business rules, measuring bottom-line iiiqpact'dn consumer 
behavior. Again, this information can be analyzed across profiles, time periods, products and 
categories. Finally, at the most basic level, enterprise users must understand how consumers 
20 are behaving on-line. Therefore, intelligence system 200 provides key information on 

consumer profiles (e.g., who are my consumers?), page views and click-throughs (e.g., where 
are they going on the site?) and consumer purchase patterns (e.g., what are they buying?). 

Intelligence system 200 is also equipped with a set of default tables and charts for each 
type of report, which are preferably output in a standard output form, such as Excel™, by 
25 Microsoft Corporation, aiMi customized by enterprise users as needed. All reports can be run 
in real-time or scheduled for on-going reporting. 

Additionally, the BCC 230 includes simulation capability. That is, once a new rule has 
been created, the enterprise user 112 can simulate it, prior to publishing it, by accessing the 
learning and inference engine (discussed in section 6 below) to run a prediction for success on 
30 the considered rule. Thus, marketing initiatives can be tested internally, before publication (or 
launch). As a result, failed initiatives are minimized and optimal on-line results may be 
realized. 
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2. The Core 210 

Again with reference to Figure 2, both the core 210 (and its rule evaluator) and the AI 
module 220 are key components that run on the intelligence system server 162. Core 210 
provides operating system-level and other services to the intelligence system applications and 
5 modules. The intelligence system server 162 is responsible for distributing events to the 
appropriate services and to the intelligence system database 163, to be logged for future 
reporting purposes. 

The core 210, which is the "heart" of the intelligence system 200, also includes a 
messaging facility and offers dynamic views of available computer resources. Using a highly 

10 distributed architecture, plug-ins, load balancing, sophisticated messaging, and events, core 
210 continually ensures maximum utilization of system resources and retains only those objects 
that relate to active sessions. Merging a variety of methodologies, the core provides a robust 
intelligence system to an enterprise's e-conmierce system, delivers high scalability and 
automation, and supports multiple applications. The core 210 acconq>lishes this primarily in 

15 two ways. First, the core uses plug-ins to automate system processes, such as data retrieval 
and rule evaluation. The plug-ins act independently of other system components and can be 
deleted, edited or modified instantly without rebooting the system; Secotfil, the core 
implements a highly efficient, adaptable messaging system. The core reads files in XML and 
transmits in XML DOM, i.e., formats supporting the mtelligence system's 200 distributed 

20 architecture. 

These four main features underlie the core 210's reliability: plug-ins, load balancing, 
messaging, and events, and one summarized below. 

1) Plug-ins: Plug-ins are executable components of the core created for a specific 
business (or enterprise) function. They can be created, invoked, updated, and removed in real- 

25 time without interrupting the system operation. Plug-ins contribute to the intelligent system's 
flexibility by allowing rules to be created, edited and deleted during run-time. Business rules, 
business objects, and certain other components are plug-ins, as examples. 

2) Load Balancing: Load balancing is the term given to the inteUigent system's ability to 
control the distribution of sessions (or tasks) over a group of virtual machines. Load balancing 

30 facilitates optimal deployment for any given hardware configuration, ensuring that a given 
machine is not overloaded with sessions, relative to other machines in the distributed 
architecture. More demanding services are placed on the machines with the highest capacity, 
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as determined by a load balancing system. This combined with he ability to nm on more than 
one physical machines achieves scalability. Generally, load-balancing functionality is known 
and not discussed in detail herein. 

3) Messaging: Query request contexts (QRC~s) agents are the intelligence system*s 
internal messaging agents (QRC™ is a trademark of Manna, Inc. of Newton, MA). In the 
preferred embodiment, messages are sent to components external to the intelligence system's 
server 162 in XML format, and transmitted mtemally in XML DOM format, wherein both 
formats are generally known in the art. A QRC™ agent contains data, a session number, a 
consumer ID, a list of target plug-ins (to receive the QRC™ agent), and a list of objects that are 
interested in receiving a reply from the target plug-ins. 

4) Consumer Events: Typically, a system integrator, in conjunction with an enterprise 
system administrator, establishes or defines events. Each event is recorded in a configuration 
table, which is stored in the intelligence system database 163. Any visitor (e.g., consumer) 
action on the e-commerce Web site (or server 152) can trigger an event (e.g., a visitor 
registering his name). There can be usage of internal system events as well. 

2«1 Rule Evaluator 

A rule is a specified business scenario that can occur on-line, im:luding an interactive 
event that is triggered by a scenario. The rule evaluator, a component of the core 210, is the 
mechanism that evaluates information generated by an external event (e.g., a consumer 
purchase) according to a business rule. The rule evaluator receives the rules established by the 
business command center 230, and evaluates each rule using data stored (e.g., in database 163) 
or the intelligence system's consiuner behavior models combined with other available data. 
The result is routed to cUent 154 in real-time, using the intelligence system's server's 
messaging facility. One business rule can serve many sessions and can be in one of two states: 
published or unpublished (as indicated in Figure 3), wherein the state of the rule is controlled 
through the business command center 230 (as discussed above). A published rule is active in 
the personalization server, whereas an tmpublished rule isn't active, but it also appears in the 
rule database 163. 

The business rule evaluation cycle is summarized in the flow chart 400 of Figure 4. In 
a typical scenario, a visitor comes to the e-commerce Web site and triggers an event that is 
sent to the intelligence system's server 162, in step 402. The rule evaluator, in step 404, only 
looks at the published rules that fit the current time frame to see if they apply to the event. 
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The rule e valuator then, in step 406, filters out all rules that do not have the event m the 
situation parameter, not yet determining if the rule will be evaluated as "true". The next step 
is the evaluation of the clauses in the situation and profile components of the remaining (i.e., 
not eliminated) rules. If the situation evaluates to be true, then the profile is checked, in step 
5 408. During profile evaluation, queries are performed against operational and historical 
databases 143 or against the consimier behavior models fi"om AI module 220. If the profile 
also evaluates to be true, in step 408, the result parameter (or level) is determined and sent 
back to the client 154, in step 410. The system then returns to step 412 and waits for another 
event, in step 412. All of these could run in parallel (assume 2 events arrive at the server at 
10 the same time). 

3. CUentl54 

Client 154 uses highly adaptable, yet standard, protocols to mediate between all leading 
Web applications and the intelligence system server 162. The client can support a single Web 
application or adapt itself to work with Web applications distributed over a nimiber of hosts, as 
15 well as "non-sticky" sessions. 

4. Intelligence System Database 163 

The intelligence system database 163 stores the cqnfigiuration tables required for system 
setup, business objects created using a business object developer, and business rules created in 
the business command center 230. Log files created by intelligence system 200 for reporting 
20 purposes are also stored in the intelligence system database 163. The data is stored in standard 
XML format so that it is easy to send the information between system components. 

5. Administration Tools 240 

The intelligence system 200 includes administration tools for implementing and 
maiTitaining a Stable, scalable, personalized enterprise system, in this case a Web-based e- 

25 conmierce system, such as the business object developer (BOD). The BOD is an automated 
tool for creating business objects and their operations, which are later used as building blocks 
by the BCC to create rule components. Implementing a user-friendly graphic interface, the 
BOD implements a browser-based approach and "wizards" to facilitate ease of use. Business 
objects are designed for three stages of the rule evaluation process 400, namely, the evaluation 

30 of the situation, profile and result components. 

Toward this end, the BOD supports operations relating to: 

1) SQL, which identifies standard SQL queries to retrieve one or more data values 

19 



I 



wo ooy7a48i 



PCT/USOO/13360 



2) Stored Procedure, which identifies standard store procedure routines with defined input 
and output parameters; 

3) Session history, which relates to events that happened in the site that are sent from the 
client 

5 4) Java, which can execute consmner written Java code, and any other necessary operation 
Gike accessing a 3"* party server for more information, operating on given data and 
returning it processed etc.); and 
5) Artificial Intelligence Module, which is used to access Bayesian Network Models. 
Business objects are the fundamental building blocks of any business rule. Once 
10 created with the BOD, the business objects are available to the enterprise through the BCC for 
creating or modifying enterprise related initiatives or business rules. A business object is a 
group of related business functions called "methods" or "operations", and provides a 
mechanism to group like methods. A business object may be expressed in the format: 
BusiKssObjectName.Method(Parameter). Methods are pieces of business functionality that 
15 are derived by accessing consumer and legacy databases, data stores, or through a series of 
procedures. Parameters are the values required to properly evaluate methods. However, as 
wiU be imderstood by those skilled in the art, not all methods require parameters. 

For example, a business object could be "Consumer'*, offering a choice of several 
methods, including "Age", "Address" or "Occupation", among others. Each method may 
20 have a selection of parameters that is used to determine the value of the method, such as a 
consumer number. Thus, an example of a complete business object would be: 
Consumer.Address(ConsumerID), 
When used in a rule, the business object is written as: 
Consumer.Address(ConsumerlD) = "NewYork" , 
25 This can then be evaluated for any consumer to determine if it is true or false. 

As noted previously, a business rule is a series of clauses consisting of business objects, 
which are evaluated sequentially to determine whether the overall rule is relevant for a specific 
consumer at that moment. The sequence of evaluation of the rule is: 
Timeframe = > Situation = > Profile, and if all are true, then Result. 
30 Within the core 210, the rule evaluator determines where to go to evaluate business 

objects. This may require invoking click-stream data stored within the historical database 143 
and/or database 163 to see if the consmner has just completed a specific action on the Web 
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site, or by using stored demographic or past buying data (stored in enterprise databases 143 or 
by using the artificial intelligence module 220) to determine the best Profile or Result to target. 
6. AI Module 220 

The AI module 220. is the "brain" (or AI engine) of the intelligence system 200, and 
5 makes real-time recommendations and predictions based on consumer behavior models, 

continuously updating them with new information. The AI module 220, more than any other 
conq>onent, is what transforms a standard e-commerce site into a dynamic learning and 
inference center. The AI module 220 creates and employs intelligent virtual agents that are 
capable of automatically learning, utilizing and sharing learned knowledge to serve the client 

10 154 using inference. The intelligence system's 200 robust, scalable and distributed server 
architecture allows multiple virtual agents, learning independently, to form a tmified 
intelligence entity, which acts as a single distributed "virtual brain". Learning scalability 
enables the intelligence system 200 to deal with the exponential growth of data and to learn 
large data sets rapidly. Learning takes place incrementally using intelligence system's 200 

15 learning algorithms (described in more detail below), which provide an expedient approach to 
dealing with enormous amounts of data. The weights and structure of models are updated in 
real-time, as soon as a new piece of data arrives. These iiKremental; real-ti^ updates enable 
learning from massive amounts of data without needing to access all the data at once or 
repetitively. Incremental learning also gives the intelligence system 200 the ability to learn in 

20 the dynamic Internet environment, where information constantly changes. 

Consumer behavior models are unplemented as Bayesian network models. Unlike other 
learning models (e.g., collaborative learning and neural networks), the Bayesian network 
models can work with mcomplete data cases and levels of uncertainty. Once deterministic or 
probabilistic evidence has been obtained, the probability distribution for an attribute or 

25 combination of attributes can then be determined dynamically, in real-time. These consumer 
behavior models are reusable and can be combined to form new models, saving on both data 
resources and learning power. The model buUding process constructs attributes, defines their 
values and then gathers them into models according to logical relationships. These models are 
then inter-linked, based on their statistical coupling. In addition to profile attributes, models 

30 include products/services and categories. 

Bayesian network models are built off-line and tailored by intelligence system 200 and 
then customized for the enterprise's e-commerce Web site. Off-line learning involves running 
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several intelligence system 200 programs with several input data files, resulting in a set of 
Bayesian models that include variables and probability connections between those variables, 
which may be expressed in tables. 

The Bayesian models are adapted during normal system operation to reflect knowledge 
5 gained through on-line learning. As consumer-related events occur, they are logged into a 
database (e.g., database 143). At preset intervals, intelligence system 200 opens the database 
and puts the information gathered into data files. The data files are continuously updated as 
new events occur. On-line learning processes the files, updating the values in the models' 
probability tables. This action permits an e-commerce site to learn quickly and accurately 
10 about the trends and patterns of consumer behavior and activity. 

In the preferred embodiment, the AI module 220 is comprised of two main parts, a 
machine learning system (MLS) 510 and an inference system (IS) 520, as shown in Figure 5. 
The MLS 510 automatically creates Bayesian network models based on consumers* past data. 
These models are then used by the IS 520 as on-line intelligent resources. All of the following 
15 intelligent operations can be obtained fit)m these models: prediction, classification, mayimiim 
e;q>ected utility optimization. 

Both of the MLS 510 and IS 520 are desigi^ using parallel distributed Java object- 
oriented code, allowing advantage to be taken of the distributed application server architecture. 
With parallel distribution, the processes of machine learning (using MLS) and inference (using 
20 IS) are scalable. This in^)lies that for making inferences the number of on-line sessions that 
require intelligent resources is scalable, while for machine learning the number of Bayesian 
Network Models is scalable with the number of computers (or servers), 
6.1 Machine Learning System 510 

The MLS 510 provides (1) automatic building of Bayesian Models (including attribute 
25 or feature extraction) based on an existing consumer-domain knowledge as well as on available 
data, (2) automatic learning of the built models (including structural/parametric estimation), 
and (3) automatic continuous adaptation of the Bayesian models based on new data and/or new 
domain knowledge, which includes the capability to incrementally change the structure based 
on data and add/delete attributes/links without loosing learned information from older data. In 
30 the MLS 510, there are two information "channels", one for obtaining client data and the other 
for obtaining client domain knowledge. 
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6.1.1 MLS Architecture 

The MLS 510 merges two independent technologies; parallel distributed processing and 
advanced machine learning, in implementing an efficient, fault tolerant (via its distributed 
agents) and fully configurable system. Architecturally, MLS 510 includes two main parts. An 
5 off-line sub-system automatically builds Bayesian network models based on input data files, 
runs advanced off-line learning processes that produce the strucmre as well as the probability 
parameters for the models. An on-line sub-system is deployed as any other regular plug-in on 
the server and updates the Bayesian. The MLS 510 continuously operates in a backgroimd 
manner to adapt Bayesian models and to update them with new statistics based on the newly 

10 acquired data. Note that all references to the word 'off-line' versus the word *on-line' mean 
that the off-line process is carried out using a program that need not be run on the intelligence 
system server 162, but rather on a separate Java machine, in the preferred embodiment. 

Largely due to its distributed architecture, the MLS 510 is able to provide a potentially 
unlimited amount of machine learning resources (limited only by the enterprise's number of 

15 coin{>uters) that are scalable and configurable, while at the same time supporting a broad range 
of dynamic, real-time adaptation of these resources fi^om a variety of sources. These resources 
are based on Bayesian network models (or Bayesnet models) that canieam to estimate joint 
probability distributions med for predictive inference and clustering (i.e., unsupervised 
learning), which is used to discover groupings in the data. 

20 MLS 510 is capable of using iiiformation from a variety of sources to construct and 

ad^t the Bayesian network models. The sources of information handled by the MLS for 
adapting the models include qualitative knowledge about the domain, e.g., specifying 
associations and dependencies concerning attributes; such knowledge can be entered directly 
(e.g., manually by adding/deleting attributes from models) via a Java-based graphical editor, 

25 for example. Another source of information is, of course, the data itself, which leads to a 
machine-initiated adaptation as part of the machine learning process. The Bayesian network 
models, when saved in a secondary storage, are represented in the XML standard, so that they 
are usable by other possible sources of adaptation, including external applications that can 
intelligently modify such models. 

30 A key aspect of the MLS 510 is that the above adaptations can be carried out in an 

interleaving manner during the lifetime of the model. For instance, initially, a model may be 
automatically built by off-line learning. The on-line learning processes can then take over and 
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adapt the model over the next month of new data, as an example. An individual (e.g., an 
enterprise user 112) can then edit the model, add new relevant attributes, delete some other 
attributes, and insert new association links between existing and/or new attributes. The on-line 
learning can then continue to adapt the model based on the new structure, while keeping ail 
5 important probabilistic parameter information that has been learned during the past month. 
For instance, the probability distribution of "AGE" given "GENDER" will be maintained even 
if according to the new structure a new attribute named "LOCATION" has been added. 
6 A. 2 Distributed Machine Learning 

The MLS is comprised of multiple autonomous Java "learning agents'" (LAs), each of 

10 which is responsible for learning a single Bayesian network model. The task of learning is 
acconq)lished by efficient parallel distributed processing starting from the lowest level of the 
learning process, which is filtering locally relevant data for each model, to the top level, 
updating the Bayesian network model at a central model repository (CMR), described in more 
detail in section 6.2 IS 520. 

IS Each learning agent looks at the same continuous serial stream of incoming data (from 

seriaLdat files). Each learning agent then extracts from the stream only data relevant to its 
model. The agent re-samples this serial data and converts it to parallel data cases. If and 
when some of the data is incomplete, for instance, if the value of the model attribute AGE is 
unknown then the learning agent has at its disposal an inference engine (i.e., the same Java 

20 object discussed with respect to IS 520, described in section 6.2 herein) which is used to 

complete the imknown value based on an expectation-maximization (EM) algorithm, wherein 
an EM-algorithm is a well-known technique for estimation of statistical parameters with 
partially incomplete data. 

Learning agents constantly adapt the model parameters. Ultimately, a model is updated 

25 to an extent that it can be used by IS 520 for making inferences (e.g., for providing 

reconmiendations to on-line consumers). The process by which a model that just completed 
learning becomes available as an on-line resource is fully automatic and involves certain 
intelligent synchronization between MLS 510 and IS 520. 

Learning agents cooperate amongst themselves and also with inference agents (lA) by 

30 responding to requests that change their set of attributes. An example of this takes place as 
part of the adaptation of the link structure that link ""inference agents"" (see section 6.2 IS 
herein). In this case, an inference agent named HLA, every so often, sends a message that is 
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intercepted by all learning agents, which causes multiple pairs of learning agents to exchange 
local information, import/export attributes, and so on. The augmented models then continue to 
be learned without the loss of previously learned probabilistic information. Another example 
is the model update. Once a learning agent writes its latest version of a model to the CMR, the 
5 CMR notifies the appropriate inference agent about the new update. The inference agent, even 
if it is at a state of using an older version of the model, is able to read the new version of the 
Bayesian model and use it for new sessions. As can be appreciated, there is a high degree of 
cooperation between inference and learning agents. Together they form an adaptive system 
influenced by changing data and domain knowledge. 

10 6.1.3 Madiine Learning Processes Overview 

MLS 510 is implements of two main processes: a one-time off-line building and 
learning process and an on-poing on-line learning process . The off-line process is an 
automatic process by which Bayesian network models are built using feature extraction. The 
off-line process need not be nm on the intelligence system server 162, since it is more of a 

15 baclE^und process. Once built, hyperlinks are constructed that define the association between 
statistically related models, and an off-line learning process is performed to arrive at a fiilly 
learned model. Building a Bayesian model is an iterative process by - which important attributes 
are determined, grouped and associated. 

On-line learning is an incremental learning process, which reads only once through a 

20 given stream of data. The primary responsibility of the on-line learning process is to ensure 
that the models are updated as time progresses. While the off-line learning process need not 
run on server 162, the on-line learning process does run on server 162, since it has real-time 
interaction (e.g., updating) with models available to other real-time processes. For instance, 
the on-line learning process is able to automatically and quickly adapt Bayesian network 

25 models based on a real-time incoming click stream of data. The on-line learning process 

employs algorithms that modify the structure of the Bayesian network models, as well as track 
the changing parametric statistics over time in order estimate each model's probabilities. 

On-line learning is a local learning process. Each model gets lean^ and improves 
itself over time. Off-line building, on the other hand, does attribute extraction from data. This 

30 requires that the whole domain of attributes (not just those that are local to a single model at a 
time) be considered. As such, off-line learning is a more involved process and it requires 
iteratively reading the input data multiple times. 
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While Bayesian network models may be built automatically using the off-line learning 
process, they could alternatively be constructed using on a partial or completely manual 
process. As an example, partial building could mean manually ascribing a structure (e.g., for 
instance a naive Bayesian structure), while automatically learning the probabilities. In this 
5 case, off-line building is not necessary, while on-line learning is needed in order to adapt the 
model over time. The on-line learning process can adapt models regardless of how they were 
originally learned, e.g., through the automatic off-line building/learning process or manually. 
The on-line learning process can also continue to learn models after modification, for instance, 
after a new attribute is added to the model, without loosing previously learned parametric and 
10 structural information. 

The off-line learning process is comprised of the following stages (or steps): 

1) Defining an AI entity domain based on a hierarchy of codes, which gives rise to a 
single file named totalproductinfo.dat, 

2) Defining a seriaLdat file that, as the name suggests, is a serial stream of contiguous 
IS blocks of data (referred to as serial cases). 

3) Automatically building models based on the above files resulting in sets of attributes 
(referred to as "intrinsic attributes"), which are logically related (according to the 
hierarchy of codes defined in the totalproductinfo.dat) and a set of non-intrinsic 
attributes that have been determined to be statistically correlated with the intrinsic 

20 attributes; this process includes a "feature extraction" stage (as referred to in the art). 

4) Converting the serial stream of data into a paraUel stream of data by employing a re- 
sampling technique; parallel cases based on the serial data are produced for each model. 

5) Generating a durected hyperlink topology that links statistically related models; these 
form the basis for the inter-agent commtinication network. 

25 6) Producing a Bayesian network model with an optimal structure (based on statistical 
properties) and parameter values using the automatic off-line learning process, which 
runs an advanced machine learning algorithm, based on the cases. 
Unlike prior systems, the MLS 510 of the AI module 220 provides an automatic way in 
which complex statistical models are learned, requiring very minor human intervention, e.g., 
30 only at the start of the process through the definition of the domain. This definition stage is 
carried out through a sequence of simple database operations that merge mto a single file all of 
the products (or more generally AI entities) on which the AI system can learn and produce 
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intelligent predictions. The off-line learning process is configured for use by non-technical 
enterprise users and is the basis for a relatively quick on-site AI integration phase (i.e., 
integration of the intelligence system 200 in to an enterprise's system). 

As discussed briefly above, the on-line learning process adapts (i.e., modifies over 
5 time) the Bayesian network models built by the off-line learning process with an aim of 

ensuring that the models' representations of their respective domains remains accurate as these 
domains change over time. This means that both the probability distributions of the attributes 
as well as interdependencies remain up to date. The on-line learning process has the following 
key aspects, in the preferred embodiment: 
10 1) hipui data stream is fully compatible with the data used in the off-line learning process, 

so that off-line and on-line learning can be interchanged or repeated at any time. 

2) A simple input data interface, which continuously polls the existence of new data files 
fully, automates the on-line learning input-acquisition process. 

3) A re-sampling technique for converting the serial stream into a parallel stream (same as 
15 in off-line building). 

4) Includes a local statistical repository (LSR), per model, which holds the statistics 
needed to estimate the model's parameters and structure. The LSR holds, in a concise 
format, all statistics collected from the initial deployment of die system and preferably 
has a high degree of fault tolerance by performing regular saving of files through 

20 standard Java-serialization techniques. 

5) Implements incremental learning, so there is no need to store and remember data cases. 
This feature is well suited for a dynamic, data-rich, real-world environment, such as 
with e-commerce sites on the Internet. Incremental learning of parameters using a 
standard known algorithm and incremental learning of the structure of each model. 

25 6) Provides an ability to learn with incomplete data, based on the EM-algorithm. 

Inference is accomplished as a completion mechanism for learning, followed by a 
formation of multiple parallel probabilistic cases with a real-valued weight. These 
cases then update the LSR using the same process as regular cases coming from 
complete data. 

30 7) A configurable automatic "window-of-focus" permits the adaptation of models 

according to a decreasing level of importance for older data. This is constanUy in 
effect, thereby making the new incoming data stream always more important for 
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inference purposes. 

8) Accommodates manual structural changes (i.e., editing) to a Bayesian model, 
adding/deleting attributes, and modifying links, all of which are automatically 
interpreted by the CSR, which immediately starts to collect new statistics based on 

5 these changes. A model update continuity property is employed, wherein structural 

changes are reflected in the learned model with proper weighing, i.e., the more recent 
statistics (after the change) having less weight than older ones. 

9) Accepts automatic external data streams for adding/deleting attribute values to/from any 
model. 

10 10) Hyperlink topology adaptation (HLA) is used, wherein the inter-agent commimication 
network adaptively changes with time, tracking new statistical correlation between 
agents of different contexts. 
11) Fully configurable and dynamically changeable learning parameters and learning- 
processes are efficiently monitored. 
15 6.1.4 Machine Learning Process Description 

As mentioned briefly above, the off-line learning process is the initial stage of the 
machine learning process. In the preferred embodiment, there are two'files through which the 
off-line building process gets its necessary information. The first file encapsulates the domain 
for the AI module (e.g., totalproductinfo.dat file). The second file is a sequence of blocks (or 
20 "serial cases"), analogous to a series of consumer orders, each block lisdng the Ml path names 
of AI entities which are related to each other by the fact that they are in the same serial case 
(e.g., a serial.dat file). 

An AI entity is a unique subject, e.g., a product, which can be represented such that the 
learning process can associate it with other various AI entities in a statistically manner. The IS 
25 520 is then able to do predictive inference on the AI entity. According to the coding format of 
the preferred embodiment, each AI entity representation includes a comma-delimited sequence 
of codes. An example of an AI entity having 4 codes is: 'Ar,*BAK',*BAKBAG', 400343*. 
The sequence may have variable nimiber of code names for different entities. An example of a 
code domain having a fixed-code of width equal to 4 that describes a product hierarchy is: 
30 Acode, Bcode, Ccode, productlDcode. Here, a product is an AI entity that has a fiiU path 

code, e.g., AI, BAK, BAKBAG, 12911 (which indicates a bagel product). The full path code 
shows that the product is from the AI category, BAK subcategory, and BAKBAG sub- 
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subcategory, with a product ID code of 12911. 

Basically, any string name can be used as a code name. Generally speaking, in 
choosing the set of possible codes, one wishes to convey a certain logical relationship about the 
"real world" domain. Additionally, AI entities can be described at different levels of 
5 resolution. For instance, in the last example, the bagel product comes from a defined Fresh- 
Food-Category having a code "Al The bagel product also comes from a defined Bakery- 
Category having a code "BAK", which appears as a subcategory under the Fresh-Food 
category. 

Once the totalproductinfo.dat file has been generated, the data files, which convey 
10 associated items, are put in the format of a list of associated full path codes that are denoted as 
the serial.dat file, in the preferred embodiment. Together, the two files form an AI domain 
and input definition according to which many real-world domains, whether they represent 
products, user profile values, etc., can be well-represented. In the preferred embodiment, a 
serial stream, rather than a parallel set of cases (as, for instance, required by other learning 
IS methodologies, such as neural networks), permits a variable length contiguous blocks of 
associated items. Consequently, the present approach permits a variable degree of evidence 
per serial case, which is typically the case in a real-world input diata iSleT 

This general representation scheme inherently has logical hierarchical relationships. As 
a result, a given serial case can be easily split into multi-contexts simultaneously, at very little 
20 system cost. These multi-contexts projections of the same serial case are presented to various 
models simultaneously, each causing an update of its respective model. For instance, the serial 
case: {A1.BAK.BAKBAG.1202, A2.ICE.APPL.493, B2.COF.SAhfK.303} simultaneously 
effects the AI model, the Al.BAK model, the A2 model, the A2.ICE model, the B2 model and 
the B2.C0F model. 

25 The totalproductinfo.dat file is a listing of all valid AI entities and their respective code 

names. Figure 6A shows an exanq)le of sections of a totalproductinfo.dat file, including its 
format. In the example of Figure 6A, each AI entity has a code name consisting of 4 codes 
(the first 4 values in each line). The remaining 4 values are description names of each of the 
codes respectively. In general, AI entity code names may have a variable number of codes. 

30 The serial.dat file is a single stream of data used both for off-line building and on-line 

learning. It is defined as any stream of consecutive AI entity code names appended by an 
order number. An example of a portion of the serial.dat file is shown in Figure 6B. 
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Regarding the example of Figure 6B, several points may be appreciated. For example, the 
serial.dat file is a collection of serial cases sorted by the order number of each AI entity, which 
is the last code in each line, wherein a serial case is a collection of AI entities. The number of 
codes of an AI entity riiay vary from one AI entity to the i^xt. 
5 6.1.5 Attribute Extraction and Hyperlink Formation 

Once the AI entity domain has been defined and incoming data has been represented 
according to it, the off-line building process starts. As part of this process, an attribute 
extraction technique according to the present invention includes the following key steps or 
aspects: 

10 1) Collecting and forming sets of logically related attributes, i.e., according to their 

'nearness' in the logical hierarchy, as defined in the totalproductinfo.dat. For instance, 
an attribute for each subcategory imder AI is added to a conunon set denoted as an 
intrinsic set of the model AI. 

2) Iteratively scanning the serial.dat file, wherein each Bayesian model computes a 

15 representative set of attributes ("rep-sets"). Pairs of models whose rep-sets are highly 

mutually informative get linked via an in^rtation of rep-set attributes fi^m and to each 
other. As a result, a topological Bayesian mtwork (different firom the logical tree-like 
hierarchy) is built that links the models. 

3) At the end of the process, there exists a collection of Bayesian models (not yet 
20 "lean^") that are dependent both in a data-based sense (through the statistically 

formed topological links) and through logical relations. 
This a fully automatic process of incorporating both prior domain knowledge (based on logical 
relationship) and empirical data information into a single unified collection of attribute sets 
which are later to become Bayesian models. 

25 In the preferred embodiment, each hyperlink has a value that is proportional to the 

mutual information between the two respective representative sets. This coupling of models 
serves as a basis for a measure of information over the communication channel. An inference 
agent, when having the choice to receive information from multiple agents, decides from 
whom to receive, based on this coupling and also based on the evidence (or data) available in 

30 each of these agents. 

Figures 7 A and 7B show examples of logical and topological relations linking models, 
respectively. For example, in Figure 7 A a topology of inference agents 700 is shown. In this 
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example, for instance, model A2 702 is connected to model Al.DAR 704, which suggests that 
there is a strong association (the strength of which is available to the two models) between 
patterns of product orders on the domain of model Al.DAR. In this example, model Al.DAR 
704 happens to represent dairy products ("DAR") and model A2 702 represents the domain of 
5 frozen foods. These models are also related according to the logical hierarchy 750 shown 
Figure 7B. In this case, model Al .DAR 704 is represented as a folder "Dar" 708 that is 
subordinate to (or included in) folder "Al" 706, wherein folder Al 706 has a close relationship 
with A2 710, i.e., Al 706 is at the same level and proximate to A2 710 in the logical 
hierarchy. 

10 6.1.6 Off-line Building Algorithms 

The data serial.dat and totalproductinfo.dat files may be prepared using a stored- 
procedure database routine or some other external mechanism. Once the totalproductinfo.dat 
file exists, the corresponding model definition based thereon has a variety of characteristics. 
For example, given a corresponding Bayesian Network model by the nan)e of "Top" (shown in 
15 Figure 7B), all of the first code names (i.e., the first code in each Ime of the 

totalproducitnfo.dat of Figure 6A) are defined as attributes of the model Top, Additionally, all 
3 consecutive code names are recursively obtained. As an example, let the first code be the 
model name, the second code be an attribute name and the third code be an attribute value for 
the respective attribute. 

20 For instance, based on Figure 6A, a Bayesian model by the name of Al is created with 

the following attributes; Al.BAK and A2.VGP. The Al.BAK has the following values: 
'BAKBAG*, 'BAKBRD'. The attribute A2.VGP has the foUowing values: *FRZVGG\ 
'FRZVBE'. In a similar manner, a model by the name of Al .BAK is created with the 
following attributes: Al.BAK.BAKBAG and ALBAK.BAKBRD taking the values: '100335' 

25 to '100357' and '100366' to '100376' respectively. 

Before proceeding to the building algorithm, it should be understood that an "intrinsic 
attribute" of a Bayesian model is an attribute whose name consists of the model's name as a 
prefix followed by an additional single code name. For instance, Al.BAK.BAKBAG is an 
intrinsic attribute of model Al.BAK. Given the totalproductinfo.dat and serial.dat files, the 

30 model building proceeds according to the following steps: 

1) Create a directory structure where each directory corresponds to a single Bayesian 
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model and the logical names of models are a function of their placement in the directory 
structure (see Figure 7B). 

2) Let > 1 be a given parameter (where d represents the number of hyperlmks). 

3) For each model in a set of models: 

a) Collect all intrinsic attributes. 

b) Prepare a representative set (see rep-set discussion below). 

4) For a specific model X from the set: 

a) For each model M^X (where model M represents each model in the set that is 
not model X): 

i) Compute the score S(X, M) and store in list LL 

b) Let there be d hyperlinks between model X and d other models M whose score 
S(X, M) is in the top d scores in the list LI where a hyperlink is created using 
algorithm exchange Attributes (see the exchange attributes discussion below). 

c) Store the d hyperlinks in list L2. 

d) Prepare a representative set for model X and for these d models. 

5) Scan list L2 and remove duplicate hyperlinks ending up with a single hyperlink between 
any pair of models. ' 

6) Print out into a hyperlinks. xml file, a list of all hyperlinks. 

7) For each model X: 

a) Create and print into a file cases, dat in the respective directory of model X the 
cases for model X (see case created for the model discussion below). 

b) Print the attribute information for the model X into a file varinfo,dat in the 
respective directory of model X. 

We now review the necessary algorithms used above. First, the algorithm used to 
prepare representative sets: 

1) Given a model X and a given parameter /. 

2) For each attribute A in model X: 

a) Compute the score S(A) as the total mutual information between A and any 
other attribute. 

b) List the t highest scored-attributes and place in list L. 

3) Output list L as the representative set for model X. 
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Next, to exchange attributes: 

1) Given two models X and M. let their representative lists be Lx and Lm respectively. 

2) Let model X import the attributes listed in Lm and label them as non-intrinsic attributes 
for X. Let model M import the attributes in list Lx and label them as non-intrinsic 
attributes for M. 

3) After importation, remove any possible duplicate attributes in model M and in model 
X. 

To create cases for models: 

1) Given a seriaLdat file and given model X with its intrinsic and possibly non-intrinsic 
attributes. 

2) Initialize a list LC of cases to empty. 

3) Scan once the seriaLdat file and for each serial case (SO which contains at least one AI 
entity whose code name has as a prefix the name of model X do the following: 

a) Let Lx be a list of all AI entities in SC whose name has as a prefix any one of 
the attribute nan^ of attributes in X. Let c be the cardinality of Lx. 

b) Obtain the order-dependent probability distribution for each such attribute, for 
example, given SC = 

{{ AI ,BAK,BAKBAG, 1012,5} , { AI ,BAK,BAKBRD, 1112,5}, { A2, VGP, VGPFZ 
Z,232,5}} and given model X name is AI with intrinsic attributes = Al.BAK, 
Al.FRT and non-intrinsic attributes A2.VGP, A2.ICE then the order dependent 
distribution for the attributes is as follows: 

i) Attribute Al.BAK has {[NULL,0], [ BAKBAG, 0.5], [BAKBRD, 0.5]}. 

ii) Attribute Al.FRT has {[NULL, 1], [FRTA, 0], [FRTB, 0]}, 

iii) Attribute A2.VGP has {[NULL, 0], [VGPFZZ, 1], [VGPA, 0]}, 

iv) Attribute A2.ICE has {[NULL, 1], [ICEC, 0], [ICEYOG, 0]}. 

c) Create c cases as follows: for each attribute, in turn, choose its corresponding 
order-dependent distribution, draw a value c times from its domain using its 
order-dependent distribution. Together, these form c parallel cases, each case 
having a value for each attribute of model X. 

d) Append the c cases to the list LC. 

4) Output LC to the file cases.dat for model X 

An example of a hyperlinks. xml file is shown in Figure 8. As can be seen, a single 
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hyperlink defines a connection between MODELl and M0DEL2, based on a shared set of 
attributes whose names is listed under SHVARS. The link has a coupling which is defined as 
the mutual information I(S1; S2), wherein SI is a subset of shared variables originating from 
MODELl and S2 is a subset originating from M0DEL2. For related hyperlinks description 
5 also refer to section 6.2 IS 220. 
6.1.7 DRV Model Building 

Derived models, referred to as DRV models (also see section 6.2 IS 520), are used for 
predicting the probability of a NULL and then distributing this prediction as derived evidence 
to the associated models. As far as building models is concerned, hyperlinks are not used for 
10 connecting the DRV models. The cases.dat files are formed based on a conversion process 
from a serial serialsession.dat file to parallel cases that reflect the time of entry into a 
subcategory, for each subcategory of a given category. 

An example of a serialsession.dat file is shown in Figure 9, wherein its format is 
similar to the serial.dat file. The last code name in each line represents a session number. The 
15 serialsession.dat file lists AI entity code names in an incremental fashion. For instance, with 
respect to session No. 0, the file indicates that the consumer visited category TOP, then chose 
a link taking him to subcategory Al.BAK.BAKBAG (this counts as the first entry to category 
Al). The consumer then exited and re-entered category Al, chose subcategory DEL under Al 
(countmg as the second entry to category Al), then subcategory BRD (this counts as a third re- 
20 entry to category Al), and finally subcategory Al.DEL.DELMTS (which coimts as a fourth 
re-entry into category Al). Based on this, the building process builds a cases.dat file for each 
DRV model, which contains cases that indicate for each subcategory under each category 
whether they have been entered and also at what entry time (where entry time of a subcategory 
is defined as the time that the immediate parent category was entered just prior to entering the 
25 subcategory). An example of such a case is displayed in Table 1, below. 

DRV.Al.PKG.NULL NULL 
DRV.ALPKG.TIME 5 
DRV. Al . VEG.NULL OTHER 
DRV.Al.VEG.TIME 2 

30 6.L8 Off-line Learning 

Off-line learning picks up where off-lme building left off. This is a standalone routine 
that, from the parallel data cases produced by off-line building, learns a structure and estimates 
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the probability parameters of a Bayesian model. There are various modes according to which 
different implemented algorithms are used. The algorithms are primarily extensions of well 
known, but yet advanced, statistical principles, such as statistical model selection based on 

m d 1 (MDL) criterion. For example, such algorithms and 

5 models include: 

1) Parametric learning: standard Maximum Likelihood Estimation. 

2) Structural learning: several pruning-based, as well as constructive, algorithms yield a 
final directed link structure. Representative Set based, MDL-based pruning. 

3) Constrained learning of structure where a particular focus on a specific set of attributes 
10 is made as being the attributes of interest for prediction. 

For illustrative purposes, the details of only one of the structural learning algorithms 
used in the off-line process is presented herein. Other algorithms are variations of that 
presented herein, as would be appreciated by those skilled in the art. The structured learning 
process constructively forms an initial structure. It picks out a representative set for a model, 
15 then links the rest of the attributes based on their coupling to this set. Special care is taken 
when a set of attributes is said to be of particular interest for prediction. 

1) Given a cases.dat file for learning model X and a parameter c^nd a set O of output 
attributes that are of special interest for prediction (this set may be empty). 

2) Determine the non-intrinsic attributes and intrinsic attributes of model X based on the 
20 names of the attributes. 

3) Based on the cases.dat file, compute a table TJ of all joint probabilities P(Ai, Aj) of all 
possible pairs of attributes Ai and Aj in model X. Compute a table TS of single 
probability distributions of every attribute Ai in model X. 

4) Based on TJ and TS compute a list ML of all pair-wise mutual information between all 
25 pairs of attributes Ai and Aj of model X using the formula: 

Aj) = 

Dcm P(Ai - Aj = m) log P(Ai = Aj = m)/ P(Ai = k) P(Aj = m), 

5) For each attribute A in model X, compute the score s(A) as being the total mutual 
information between A and other attributes. 

30 6) In a set R put the set of c attributes having the highest c scores. If the set O is not 
empty, add to set R its elements. 
7) For each attribute in the set R, create an outgoing link from it to every other attribute in 
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the model X while ensuring that no cycles appear. 

8) Compute the initial MDL-score(X) of model X (see the discussion on MDL Scores Of 
A Bayesian Network Model below). 

9) Repeat the following iterative process until a local minimum of MDL-score(X) is 
reached: 

a) For each link LK in the current version of X: 

i) Determine the change in MDL-score(X) for the following possible 
candidate structures: the same structure but without the link LK (provided the 
link is not one which connects an element in the set O); and the same structure 
with the link LK in a reversed direction, where the change is with respect to the 
current structure which includes the link LK. Note that the possible candidates 
must be valid, i.e., contain no cycles, otherwise continue and consider the next 
link in LK. 

b) Let the new structure of model X be the one which results in the maximum 
decrease in MDL-score(X) amongst all possible candidate structures. 

10) For the obtained optimal structure of model X, for each attribute compute the 
conditional probability tables based upon the cases.dat , 

11) Output a bayesneLxml containing the graphical structure and the conditional probability 
tables. 

Computing the MDL-score(X) for a Bayesian Network model X ir> a well-known 
computation. However, for completeness, the MDL Score of a Bayesian Network model we 
determined as follows: 

1) Let /I be the number of attributes in model X, 

2) Let #Pa_i be the number of parents of the i-th attribute. 

3) Let N be the number of cases in cases.dat, 

4) Let I Ai I be the number of values of the i-th attribute. 

5) Let Comb(n,k) = n! / (k! (n-k)!). 

6) Let H(Ai | Pa i) be the conditional entropy of Ai given the set of parents Pa i (for the 
definition of conditional entropy see T. Cover & T. Thomas, An Introduction To 
Information Theory, (John Wiley & Sons 1991). 

7) Then: 

MDL-score(X) = B (login) + log Comb(n, ffPaj) ) + 
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'A log(N) B (\Paj\ (\Ai\ + 
NBH(Ai I Pa i). 
6.1.9 DRV Model Learning 

A DRV model has two types of attributes, NULL and TIME with an outgoing link 
5 from NULL to TIME. Thus it has a fixed structure, as shown in Figure 10. The NULL 
attribute takes two values {NULL, OTHER} while the TIME attribute takes values 
{0,1,..., M}, for some constant M > 0. The NULL attribute is presented with a vahie NULL 
if in a given session the consumer did not enter a subcategory. For instance, 
DRV.Al.PKG.NULL = NULL indicates that the consumer did not enter the Al.PKG 
10 subcategory under the category Al . A value of "OTHER" indicates that the consumer did 
enter the subcategory and the associated time of entry is presented as a value to the 
corresponding TIME attribute. The time of entry is defined as the number of times the 
consumer entered the category (in this example it is Al) prior to entering the subcategory. 
Therefore, for instance, DRV.Al.PKG.TIME = 2 mdicates that the consimier had already 
15 entered category Al once. 

As depicted in Figure 10, the reason for having NULL feeding an arrow to TIME is for 
viewing the NULL as the class variable to be predicted. The model presets two possible class 
conditional distributions over the domain of TIME. The first is P(TIME | NULL = NULL) 
and the second is P(TIME | NULL = OTHER), Learning processes take care of estimating 
20 these two distributions. The inference agent of this DRV model predicts the distribution of 
NULL, namely, P(NULL) = [P(NULL = NULL), P(NULL = OTHER )] based on observed 
evidence of TIME only. 

Based on the cases.dat file obtained from the building process, off-line learning simply 
learns the probability estimates for each of the conditional probability tables of the DRV model 
25 as it learns any other "regular" model. An example of a derived case for learning the model 
DRV.Al in Figure 10 is shown in Table 1 above, which corresponds to a serialsession.dat case 
that indicates that a consumer entered subcategory VEG under category Al after having visited 
Al twice during the session, while not having visited subcategory PKG under category Al (we 
have used M = 5 as the max time limit in this example, so having 5 means that the user 
30 session terminated without having entered the PKG subcategory). 
6.1.10 MLS On-line Learning 

As discussed in the sections above, the off-line learning process generates a file in an 
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XML format that rqpresents a fully learned Bayesian Network Model. The task of the on-line 
learning process is to modify this Bayesian Network Model over time with newly acquired 
data. In accordance with the present invention, MLS 510 includes the following aspects; 

1) Local and incremental learning of parameters and structure, including advanced 

5 structural learning which involves state-space search in the space of model structures. 

2) Various flexible forms of updates, wherein Bayesian models can be changed 
structurally, i.e., links and attributes alike, with minor loss of parametric information 
that has been previously computed based on past data. 

3) Learning with incomplete data, wherein multiple probabilistic parallel data cases are 

10 formed for models that have at least a single missing value. These (weighted) cases are 

used to modify the LSR similar to regular deterministic cases. 

4) An incremental inference-assisted learning of the hyperlink network that links all 
models takes place. Preferably, a single model, named HLA, captures mutual 
interdependencies between the rest of models and automatically instructs learning 

1 5 agents to cooperate by exchanging attributes. 

6,1.11 On-line Learning Modules (or Components) 

An ORB (ORB) (such as Voyager™ by Objectspace, Inc. of Dallas; TX) provides, 

among other things. remote-Java-method invocation between Java objects on separate Java 

virtual machines (VMs or JVMs) to facilitate the MLS on-line learning process. During this 
20 process a variety of components are used, and described in table 1100 of Figure 1 1 . With 

respect to table 1100: 

1) A conqwnent is a modular sub-part of the on-line MLS learning system or of the AI 
system as whole. 

2) QRC~ agent is an XML-based object-oriented communication messaging protocol, a 
25 table 1400 describing various QRC™ agents are shown m Figure 14. Different AI 

components communicate using this protocol. 

3) Client stands for any external event-generating server, for instance, an Internet server 
that passes "product-order" events made by on-line users (e.g., client 154 and 
consumers 1 10 of Figure 2). 

30 The interaction between these components can be appreciated with respect to the on-line 

MLS block diagrams 1200 and 1250 of Figures 12A and 12B, respectively, and with respect to 
con^wnents communication table 1300 of Figures 13A and 13B. Figure 12B is a partially 
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decomposed portion of Figure 12 A and the interactions between the MLS on-line learning 
system components are described in table 1300. For instance, table 1300 indicates, in row 
1310, that the learning manager (LM) 1202 sends a QRC™ agent to the CMR 1208. 
Interaction Type of each component is with respect to another component (not a component's 
5 partner). Additionally, with respect to table 1300: 

- Admin stands for an external plug-in used to administrate/configure the on-line MLS 

- Accept/Send means a component does this action. 

• Invoke Method means component invokes method locally (not through ORB) 

- Remote Method means a component invokes method through ORB 
10 - Method Invoked means a partner invokes method on the component 

Concerning the Number column of table 1300 of Figures 13 A and 13B: 
- 1 means a single unique component 

- K means there can be a flexible number, K> 1 

- M means the number of models 

15 6.1.12 MLS On-line Learning Algorithms 

The iiq)ut provider of each LU (e.g., LU 1206 and LU 1206') accesses the same 
serial.dat file stream (e.g., input data files 1212 of Figure 12B). After completion of 
processing the current serial.dat file, each LU polls to check if a new serial.dat file has been 
placed. The format of the serial.dat is identical to that used for off-line building (see Figure 

20 6A). The LU*s i^put provider forms parallel cases from each serial case using the same 
mechanism as described in section 6.1.6 above for creating cases for models. 

Each LU 1206 contains a tree-like data structure that holds statistics necessary and 
sufficient to estimate the probabilities of any of the conditional probability distributions of the 
relevant model. There are many possible data structures that can be used. In the preferred 

25 embodiment, a structure known by the name of AD-tree 1214 (see A. Moore & M. S. Lee, 
Cached Sufficient Statistics For Efficient Machine Learning With Large Data sets, 8 Journal of 
Artificial Intelligence Research 67, 91 (1998)) which has several memory as well as 
computationally efficient properties. Using this structure, frequency counts for all variable 
combinations are taken with respect to the data and are used as the maximum likelihood 

30 estimates of the probabilities in the conditional probability tables. 

Based on the available statistics, each learning agent uses a standard state-space search 
strategy to find an optimal (in the local sense) structure for the model which has an optimal 
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MDL score (see, for instance, D. Heckennan, A Tutorial On Learning With Bayesian 
Networks, Microsoft™ Technical Report MSR-TR-95-06 (1996)). The search is similar to that 
described with respect to Figure 9, except instead of basing the estimate for the conditional 
probability distributions on the cases.dat file, the learning agent uses the statistics in its LSR. 
5 For a given current structure, the probability estimates of each of the conditional 

probability tables in a model are computed based on the contents of the same LSR. 

A learning agent writes its updated model to the CMR via the conmiunication between 
its LU and the CMR (see Figures 12A, 12B, 13A and 13B). The frequency of updates is 
configurable via a parameter in the MLS configuration setup on the server 162 of Figures 1 

10 and 2. After each model update, a learning agent computes its model's representative set using 
the same mechanism as described with respect to the algorithm for preparing rep-sets in section 
6.L6 above. All probabilistic knowledge for computing the scores of each attribute is 
available to the learning agent 1216 based on the content of its LSR. 

A Bayesian model that has been updated and written is saved in an XML format which 

15 can be read off using the JavaBayes editor (JavaBayes is a public domain Java object editor 
provided by the Free Software Foundation, Inc., Cambridge, MA and useful for creating and 
maintaining object oriented Bayesian Models). Using the JavaBayes editor, manual changes to 
Bayesian models may be accomplished, such as adding new attributes or deleting existing oi^, 
or adding/deleting values of attributes. Once these attribute-related changes are saved from the 

20 editor, the MLS on-line learning process is capable of reading (via the CMR) the XML file, 
building the Bayesnet model (or Bayesian Network Model) based on its newly changed 
structure. 

Consequently, the LU 1206 of the particular model ensures that any new serial cases 
will get translated into parallel cases (as described above in this section) that conform to the 

25 new structure. Moreover, the LSR does not loose any statistical information that was learned 
for the prior structure of the model and which is still needed by the new structure. The only 
statistics deleted are that are not necessary, based on the new structure. The algorithm that 
determines which statistics to hold and which to delete from the LSR is described above in this 
section with respect to the structured learning process. 

30 6.1.13 Learning with Incomplete Data 

The MLS on-line learning system 1250 can learn from partially-complete cases. The 
corresponding algorithm, which is an implementation of the well-known EM algorithm, is as 
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follows: 

1) An external configuration file identifies some models as "models with incomplete 
cases". For an attribute of such a model, a NULL value is never inserted by the 
learning unit's input provider. This is true both when this attribute appears as an 

5 intrinsic attribute in the model itself or as a non-intrinsic attribute in some other model. 

2) Given a serial case, the same mechanism that is described for creating cases for models 
in section 6.L6 above is used, except for the following: for those attributes which do 
not have at least one AI entity in the serial case which has them as a prefix, instead of 
inserting a NLTLL value, insert the following special value "NULL?". This forms the 

10 incomplete case c. 

3) Once the cases are read by the learning agent, given a case which has a special value 
"NULL?" the learning agent employs an object called the Learning Assistant 1218 
which utilizes the latest version of the learned model in conjunction with an inference 
engine described in section 6.2 below. 

15 4) Given a case, the learning assistant 1218 first sets respective values for all attributes 
having a non-NULL? value. The learning assistant 1218 then conoputes a joint 
probability distribution P for the subset of attributes that have a NULL? in the current 
case. 

5) Suppose there are k values in the domain for P. The learning agent 1216 transforms the 
20 original case c into k complete cases, each having a different combination comb of 

values over the attributes that originally had a NULL? value. 

6) With each such complete case an associated weight w is defined which equals the 
probability of the associated combination comb according to the joint probability 
function P. 

25 7) Once all k cases and their weights are ready, the learning agent 1216 increments its 
local statistics repository (LSR) due to each case, but with an increment not being 1, 
but rather being the weight (which is a number between 0 and 1). 

6.1.14 Hyperlink Adaptation 

Next a Hyperlink Adaptation (HLA) algorithm enables the adaptation of the hyperlinks 
30 used to connect the inference agents described in section 6.1, and is as follows: 
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1) Let there be an existing collection of Bayesian models, Ml, M2, M* fully learned 
and deployed as part of the on-line MLS. 

2) Let a model named HLA be defined as follows: define attribute HLA.Mz in the HLA 
model to correspond to a model Mi in the above collection. The attribute HLA.M/ 
takes two possible values {T, F} (i.e., true or false). 

3) A structure for the model HLA is manually defined so that it is sufficient to represent 
every possible joint probability distribution over any possible pair of models Mz and 
My. 

4) The serial.dat file is augmented using the following routine, 
for each serial case: 

a) determine the list of models everyone of which has at least one AI entity code 
that has the model as a prefix. Let this list be denoted as L. 

b) For each model X in L do: 

i) Form the AI entity code HLA, X, T. 

ii) Append the AI entity code to the end of the current serial case. 

5) Finish processing all the serial cases m this manner, which forms the augmented 
serial.dat file. _ ; ' — " 

6) The MLS learns from the serial.dat as described previously. In particular, model HLA 
learns and the corresponding inference agent (lA) for model HLA can compute any 
pair-wise joint probabUity distribution P(HLA. Ai, HLA. A/). 

7) A module called HLAM uses the HLA lA for computing the mutual information 
I(HLA.A/, HLA.A/) between all pairs of attributes. 

8) Between every pair of models Mz, Mj in the collection, a coupling c(Mz, M/) is defined 
as I(HLA. Az, HLA.A/). 

9) After every periodic update of its model the learning agent of HLA informs the HLAM 
to start adapting the hyperlinks. 

10) The HLAM creates a new list of hyperiinks L as follows: for each model X, connect 
the d highest coupled models to it. 

11) The HLAM delete duplicate hyperlinks from L. 

12) In a model building process similar to that described in section 6. 1 .6 above, the HLAM 
considers once in turn each of the learning units 1206 and repeats for each one the 
following: 
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a) The HLAM sends the list L via QRC™ agent message to the learning manager 
1202 containing the currently considered learning imit 1206. 

b) Once having received L, a learning unit 1206 instructs its learning agent 1216 
to: 

5 i) Delete non-intrinsic attributes that came from currently linked 

neighboring models, 
ii) Import the new attributes from the representative set of the new model to 
which it is to be connected based on the list L. 

c) The LA 1216 imports these attributes from each of the d to-be-linked neighbors 
10 in a similar manner to the model building algorithm described in section 6. 1 .6. 

It then re-computes the representative set using the same preparing rep-sets 
algorithm also described in section 6.1.6. 
6.2 Inference System (IS) 520 

The inference system (IS) 520 (see Figure 5) parallelizes the task of mductive 
15 inference. Inductive inference is the process of making intelligent decisions/predictions given 
observations (also referred to as evidences) which have not necessarily been part of an original 
data set used to learn a Bayesian model. As such, there are two information channels that are 
associated with the IS 520. The first is the evidence channel, which is an event-based, 
asynchronous channel by which observations are provided to IS 520. The observations are 
20 provided, in parallel, for any subset of attributes of any of the Bayesian models. The second 
channel provides the means of obtaining the prediction/decision output from any of the 
Bayesian models. This second channel is based on an interface that defines several types of 
outputs, which are called recommendations. These are described in further detail below. 
6.2.1 IS Architecture 

25 The inference system 520 merges two independent technologies, parallel distributed 

processing and artificial intelligence, in implementing an efficient, fault-tolerant and accurate 
prediction/decision inference process. As mentioned earlier, the IS has the ability to provide a 
potentially unlimited amount of AI resources (i.e., limited only by the enterprise's number of 
connputers), which are scalable and configurable, while simultaneously keeping a dynamic and 

30 efficient representation of the ever-changing state of the domain (e.g., simultaneous on-line 
user actions over multiple sessions) such that accurate predictions (i.e., recommendations to 
the users) can be promptly and reliably made. 
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The IS 520 is a main part of a single unified artificial intelligent "brain" from which AI 
inference is performed. IS 520 comprises multiple autonomous inference agents (lAs) that 
utilize the Bayesian models created by the MSL 510 to make the reconmiendations, wherein 
inference is performed using an intricate collection of localized algorithms (local at each 
agent). Inference agents cooperate, that is, they share "beliefs" on the current state of the 
"world". The inference agents listen to each other, taking various measures of confidence and 
infomoation values into account before deciding on their reconmiendations. 
6«2.2 Inference with Incomplete Evidence 

IS 520 uses Bayesian model networks to accomplish inference with partial evidence. 
The use of Bayesian model networks to represent dynamic, complex (e.g., e-commerce) 
applications suits well with the dynamic nature in which information appears and changes in a 
typical on-line product-recommendation application, for example. The IS is configured such 
that it can give reconmiendations from the very start of a consumer 's session, even if, for 
instance, personal information about the user is missing and all that is known about the 
consumer is learned from current actions made on the site. 

One of the primary advantages of having a distributed AI system 220 is in its ability to 
leam concepts on a multi-resolution level. This provides a multi^egr^*of inference about 
concepts. For instance, consider inferring about the concept of "Milk". This concept is, on a 
broad level, related to product families such as "Frozen Foods", "Packaged Foods", "Drinks" 
aiKl so on. In the preferred embodiment, the representation of milk take? place over several 
Bayesian models, each model having a context in a different inference level. As discussed in 
section 6.1, these models are automatically built using the MLS 510. These simultaneous 
multiple context levels for the same concept, for all concepts in the domain, permit a rich 
variety of inference capabilities that suit different states of evidences and thereby increase the 
chances that even with partial evidence highly accurate predictions are possible. 

Most e-commerce applications involve dynamically changing information. For 
instance, consider an on-line session of a consumer on an e-commerce Web-site. The 
consumer goes from one link to another, continuously changing the location on the site, adding 
and deleting products to a shoppmg cart. In general, not only the static information about the 
consumer, such as his gender, age and demographic information, is important for predicting 
his product liking, but also dynamically changing information. 

However, in the preferred embodiment, dynamic inference state representation (DISR) 

44 



wo 00/70481 



PCT/USOO/13360 



allows all types of evidence, whether they originate from static database tables or from rapidly 
changing user click data, are taken into account prior to product reconunendation or, more 
generally, prior to any AI prediction. The key aspect of this is referred to as Inference State 
Representation (ISR), wherein, per each user session, at any given time instant, a user's state 
5 is the aggregation of evidence and internal attribute predictions across all Bayesian models up 
to that point of time. 

Listed below are aspects of the IS 520 which ensure the dynamic updating of state (or 
Passive Dynamic State Update): 

1) Continuous evidence collection and distribution across the wide Bayesian model 

10 network in the background in a passive numner, i.e., without needing the user (e.g., 

consumer) input, which alleviates time-consuming form-filling and completion of 
multiple choice questions to build a requisite amount of user data. 

2) Simple and direct event-to-evidence conversion based on the hierarchical code format 
(e.g. a product order event for a product ID 12212 is converted to a full path name 

15 Al.BAK.BAKBAG. 12212). 

3) The above conversion permits a continuous distributed propagation of evidence so that 
a single event quickly influences the current state.to reflect a Blinge made by the user 
across the whole model hierarchy. 

4) Accumulation of evidence using deterministic to probabilistic conversion of evidence. 
20 5) In the same model, attributes can be of different types, accumulating new evidence or 

overriding new evidence. This gives a high degree of control over how new evidence 
gets updated. 

6) Internal attribute predictions used as part of the commxmicated messages amongst the 
agents are cached, which greafly reduces redundant computations. 

25 6,2.3 Derived Evidence 

Often, deterministic evidence alone is not the only information available about the 
consumer's session. For instance in an e-commerce Web-site for selling products, the 
Bayesian models learn that the buying of certain product categories A and B go together while 
when buying from category C most likely one does not also buy from category D. Therefore, 

30 the notion of not buying from some category could be as important as actual buying from a 
category, for obtaining a high accuracy of prediction. However, the difficulty is in 
determining (if not deterministically at least to a certain degree of confidence) that an on-line 
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user is one which does not buy from category A. The possibility of asking the consumer is out 

of the question, since, as a general rule, it is considered undesirable to bombard the consumer 

with questions. Generally, any user behavior, for instance expressing a variable degree of 

interest in a product, which can be formulated either based on direct consumer-related events 

or indirect effects (e.g., time of entry to a category, pattern of category entries), can provide 

an important extension of the Bayesian models. 

For the above reasons, the present invention includes a capability for deriving evidence 

that is based on predictions made by a separate set of models. These models are denoted as 

Derive Models (DMs or DRV models), and are not used for predictions geared for 

recommendation to the outside, but rather, only for Al-intemal purposes. The DMs can be 

defined to monitor various events, such as category-change events, product-order events, 

events that reflect a user's level of interest (for instance, the amount of time a user spends at a 

particular category), and are used to predict various internal attributes of the recommending 

Bayesian models (i.e., the models that are used for external recommendation to the on-line user 

or to the business marketers). Even so, the DMs are in many respects similar to the 

recommending models; they are off-line as well as on-line learned, thus can be updated over 
time. . ^■^•■r-^^^:^..^.... 

Accordingly, unlike other systems, the IS 520 generates evidence which does not 
directly come from the external world, e.g., does not reflect the purchase of a product or the 
change to another category on the site, but yet is usable by the recommending models. This 
evidence is probabilistic with varying degrees of confidence and is available for the same 
reconmiending models that usually get their evidence deterministically directly based on 
external events. Thus, a recommending Bayesian model, which has been learned and is being 
used for inference based on direct evidence, can also utilize this other source of information, 
the DMs, which derive evidence based on more subfle combinations of events or the absence 
thereof. 

6«2.4 Inference Agents (lAs) 

The purpose of inference agents is to deliver intelligent predictions and decisions 
concerning any subset of a fixed set of variables in a fixed and defined Bayesian model, while 
automatically and continuously collecting as much evidence as possible from different 
information sources which include, but are not limited to, dynamically changing information 
from inference agents, static information residing in a database, evidence due to real actions 
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taken by the current on-line consumers via server 152. 

An inference agent is, in the preferred form, a complex self-autonomous Java code 
utilizing an inference engine (IE) for computing probabilistic inferences that are used for 
delivering predictions on variables in the Bayesian model network. The lA has various 
5 interfaces which connect it to the various sources of information, based on which the lA 

receives (and also sends) probabilistic information as evidence. Also, the lA employs several 
algorithms for information communication, all of which aim at improving the value of 
information that it receives. These algorithms include probability-distribution emphasis mode 
(which may be viewed as a filtering action) and absorption from more informative peers, 

10 6.2.4.1 Classification and Prediction Modes 

The most common prediction mode used with Bayesian model networks simply 
provides the probability distribution of the targeted variable. For doing classification (as is 
known in the pattern recognition field) the well-known Maximum Aposteriori Probability 
(MAP) decision process can then be applied. The inference agents of the present invention can 

15 predict and classify in this manner. Moreover, the IS 520 also inq)lements a score-based 

classification mode that provides, for such Bayesian model networks, a higher rate of accuracy 
than the classical MAP decision process. In the preferred embpdiment; the score-based 
classification mode is referred to as the DELTA classification mode. 

In the preferred embodiment, there are 3 types of scoring functions used as part of the 

20 DELTA mode. Each is a different formula that assigns a real- valued number to every of the 
queried-attribute's values. The decision is then to choose the value with the largest score. In 
the DELTA mode an inference agent first computes the no-evidence probability distribution for 
each variable in the Bayesian model, which is denoted as P no-evid. During a session, once 
evidence begins to be observed or propagated, the probability distribution for an attribute X is 

25 denoted as P_evid(X). Let x denote any value of the attribute X, and the 3 different scoring 
formulas are as foUows: 

1) Relative-score: 

score(x) = [P_evid(jc) - P_no-evid(jc) ] / P_no-evid(x), 
if P_no-evid(x) > beta = 0, 
30 where beta is a fixed constant 

2) Confidence-score: 
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score{x) - Nonn(0, sigma, x), where 

Nonn(m, sigma, x) = (l/>/(2ns))J*^ exp(-(t - m)V2s) dt, 

and sigma is a fixed constant 

3) Omepa-score: 

score(x) = P_evid(x) to^(l/P_no-evid(x)) 
6.2.4.2 Involuntary Dispersal of Evidence 

Each inference agent constantly distributes probabilistic evidence to a fixed set of peers, 
as soon as it receives deterministic evidence that comes from the inference manager (IM) or 
evidence from a peer agent. This is conducted passively, independent of recommendation 
requests that may arrive at any time to any of the agents. The purpose of this process is to 
make the IS agents (or inference agents) as aware as possible of the dynamically changing 
evidence simultaneously for all on-line sessions on the server 162, so that when a prediction 
request for any particular agent arrives, the chances are that the corresponding agent has 
evidence, even if the user did not necessarily act in a direct context of the agent's model, e.g., 
agent Dairy will still have evidence even if a user did not buy a Dairy product. 

As an implementation, a communication network links aU infereiie agents to their 
peers and to the source of evidence. As an example, the inference manager serves as an 
interface to server 162, which is a source of evidence. This is not a conmiunication network as 
used in the field of data communication, but is rather a logical software-based graphical 
representation of the relationships (i.e., links) between agents. Over this network, 
probabilistic information in the form of Java objects representing discrete probability 
distributions are passed. One lA passes its 'belief to another lA. For instance, evidence due 
to a placement of a Dairy product in the session "basket" can become evidence that the user 
most likely is not interested in Meat products, but is mterested in Fresh Cheese products. This 
evidence is dispersed by the Dairy Agent passing its belief to the Meat Agent and to the Fresh- 
Food Agent. The present invention includes various feamres related to makmg information 
pass efficiently amongst the agent network, such as cycle avoidance to avoid redundant 
message passing and caching of previous probabilistic evidence distributions. 

In addition to involuntary evidence dispersal, there is a i^ed for evidence transfer that 
is dependent on the event of a prediction request. In such situations, each inference agent 
determines when and from whom to request evidence. This is dynamically determined based 
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on several considerations, such as the amount and value of evidence that the agent peer has 
obtained. The value relates to how many stages (i.e., agents) the evidence propagated through 
before it influenced the peer agent and also to the statistical coupling between the two inference 
agents. Also, it is possible for inference agents to operate in a synchronous mode that 
guarantees the arrival of evidence before an agent answers a prediction request. In this 
manner, it is guaranteed that the prediction took place when the maximum amount of evidence 
was at haiKl. 

6.2.4.3 Inference Engine (Efficient Computations) 

Each inference agent in the intelligence system has a pool of inference engines (EEs) on 
which it runs all inference computations. Having multiple identical service providers, such as 
these engines, permits concurrent (or parallel) processing, which can reduce significantly the 
performance times. In the preferred embodiment, each inference engine is a Java 
inq)lementation of a well-known sum-product algorithm, specifically known as the bucket 
elimination algorithm. This algorithm is extended by several ways in the present invention, as 
described below. 

1) It uses probabilistic as well as deterministic evidence. 

2) It simplifies the complexity of computations using a dynamic mafginalization technique, 
referred to herein as dynamic attribute killing. This technique allows for a tradeoff 
between prediction accuracy and time of computation, which is extremely important 
since it permits dynamically tuning the prediction accuracy based on the allowed time 
limit for returning an inference prediction. As a result, regardless of how busy the 
server 162 is (i.e., the number of on-line users), the AI recommendation response time 
will not significantly deteriorate. 

3) It predicts joint probability distribution over more than a single variable at a time, 
which necessitates finding the affecting variables of the variables to be predicted. This 
is used for inter-agent communication, 

4) It optimizes the use of a model's variables so that every attribute, regardless of whether 
it is observed with certain evidence, can serve as output for prediction. The intelligence 
system uses probability distribution marginalization to reduce attributes, thereby 
dynamically (temporarily) changing the state of evidence, but without significant bias in 
order to predict attributes values even if their states is known. 
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6.2*4.4 Inference Agents Cooperation 

One of the most important features of the AI inference system 520 is to be able to 
predict in the domain of one context when evidence is present in other contexts. For example, 
in the e-commerce field this may be referred to as doing cross-category recommendation. As 
5 mentioned above, each inference agent uses a single Bayesian model for prediction. This 
model has a particular context and its attributes are features that describe this context in 
various ways. For instance, an agent for dairy foods has attributes that characterize dairy 
products. Therefore, there is a certain context attributed to every agent. Additionally, the 
agents in a pool of inference agents cooperate by passing probabilistic messages to each other 

10 in order to give a cross-context prediction capability. It relies heavily on the communication 
network mentioned above for allowing different inference agents to influence, i.e., spread their 
beliefs or predictions, to other agents, even for agents that do not have any deterministic 
evidence (i.e., observations about the actions of current on-line users). 
6.2.4.5 Agent Hopping 

15 "Agent Hopping" pertains to the formation of a broad-recommendation to the on-line 

user based on the collective inferences of many inference agents, while also adhering to the 
main objective (as always) that the recommendation is based on prediction, which is based on 
the evideiK:e at hand and thus fits the particular user. The communication of these inferences 
occurs as a fimction of the relationships between inference agents. Like the learning agents of 

20 MLS 510, there are two ways in which inference agents are related. The first is a logical 

relationship, which is taken directly from the underlying logical hierarchy according to which 
the context categories of all agents are interrelated. The second is a topological relationship, 
which is based on a link structure that is statistically formed diuing the operation of the off-line 
machine learning system. 

25 For exan^)le, as with the learning agents, Figure 7A can be used to depict a topology of 

inference agents. In this example, we see for instance, agent A2 702 is related to agent 
Al.DAR 704, which suggests that there is a strong association (the strength of which is 
available to the two agents) between patterns of product orders on the domain of Al.DAR 
(which represents dairy products) and on the domain of agent A2 (which represents frozen 

30 foods). Additionally, again as with the learning agents, Figure 7B can be used to depict the 
logical hierarchy of the inference agents. 

The Agent Hopping algorithm carries out a hopping sequence through the topology of 
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inference agents. According to the algorithm, a sequence of agents is automatically selected, 
for instance, agent A2.BRK, Al.MTS, A2.ICE, etc., and eventually a recommendation is 
made based on the available evidence of the inference agents selected (i.e., not hopped over). 
The selection process is based on a dynamically controlled series of tests that are made once 
5 the hopping reaches a certain agent. 
The tests include: 

1) checking the amount of evidence at the linked peers; 

2) determining the information value of this evidence (which may be probabilistic); 

3) performing voluntary evidence transfer from the source agent to the hop-destination 
10 agent; 

4) ensuring that no agent is visited more than once; and 

5) traversing the logical hierarchy upward and downward according to logical 
relationships. 

These operations are parameterized so that a variety of recommendation types can be 

15 achieved. For instance, an agent does a recommendation for a product from its context domain 
when it recursively digs downward, always choosing the most likely path to the next relevant 
agent, and only makes a recommendation when reaching the lowest level agent on this 
dynamically selected path. The fact that the path is downwards guarantees an increasing level 
of specificity, which eventually leads to particular products in the hierarchy. The same is true 

20 for the opposite direction. Namely, going upward in logical links, hopping at each step leads 
to a broader view. When the required level of broadness has been reached, the hopping starts 
going downwards as mentioned above, digging deeper inside and then only recommending at 
the last agent. This time the recommendation comes from a totally different branch in the 
hierarchy, which is still related (via a path) to the original agent. Therefore, the hopping path 

25 is state or evidence dependent, i.e., it is not hard-wired but rather each session may lead to 
different hopping paths since each session may have a different state of evidence. 

Agent hopping is used to form a broad recommendation that spans the recommendations 
of multiple agents and aggregates them into one recommendation. Beyond this, the intelligence 
system 200 may make a prediction or recommendation on the same context by more than one 

30 agent by using "agent voting". For instance, suppose there is a variable named abandoned 
which may take a value of "yes" or "no" and which indicates whether an on-line user will 
abandon his/her electronic shopping cart and not buy at all. Let there be a network of n agents 
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each with a different context, while all having the attribute abandoned in addition to their 
specific context attributes. An "agent voting" algorithm combines the weighted predictions of 
all n agents on the variable abandoned and outputs a single yes or no prediction. The 
algorithm takes as a weight of an agent the confidence that it has in its prediction. This 
5 confidence is defined as the Ll-norm of the score vector (see Section 6.2.4 regarding 

classification and prediction modes). The algorithm then uses one of the following possible 
decision modes: 

1) Majority Vote: outputs the most conmion decision amongst all n agents. 

2) Maxunum Confidence Vote: outputs the decision of the most confident agent. 

10 3) Weighted Confidence Vote: computes the weighted average of the predicted probability 
distributions over all n agents and then uses the MAP-decision on the resulting 
probability distribution. 
The second decision mode above is preferred. 
6.2.5 IS 520 in Details 

15 An ORB (again, such as Voyager™ by Objectspace) provides, among other things, 

remote-Java-method invocation between Java objects on separate Java virtual machines (VMs) 
to facilitate the IS inference process. During this process a variety of components are used, 
and described in table 1500 of Figures 15A-C and shown in IS 520 block diagram of Figure 
17. With respect to table 1500: 

20 1) A component is a modular sub-part of the IS 520 or of the AI system as whole. 

2) A QRC™ agent is an XML-based object-oriented communication messaging protocol, a 
table 1600 describing various QRC™ agents is shown in Figure 16. Different AI 
components communicate using this protocol. 

3) Client stands for any external event-generating server, for instance, an Internet server 
25 that passes "product-order" events made by on-line users (e.g., client 154 and user 110 

of Figure 2). 

The interaction between components can be appreciated with respect to the IS 520 block 
diagram of Figure 17. For instance, table 1500 indicates, in row 1510, that the inference 
manager (IM) 1710 sends a QRC™ agent to CMR 1708 to request a net structure object. When 
30 reading table 1500, the "Interaction Type" of each component is with respect to another 
component (not the component's partner). Additionally, with respect to table 15(X): 

- Accept /Send means component does this action. 
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- Invoke Method meaxis component invokes method locally (not through Voyager™) 

- Remote Method means component invokes method through Voyager™ 

- Method Invoked means a partner invokes method on the component 
Concerning the Number colunm: 

5 - 1 means there is a single unique component in the AI system 

- k means there can be A: > 1 components 

- m is the number of Bayesian models 

- 5 is the number of on-line sessions 

As previously discussed in section 6.1, the CMR 1708 (denoted as 1208 in Figures 12A 

10 and 12B) is responsible for maintaining all the AI Bayesian models and serves as the librarian 
of the AI system 220. Both MLS 510 and the IS 520 need to access the Bayesian models and 
they do so via CMR 1708. The inference agents' primary interaction with CMR 1708 is in 
ensuring that they have the most recently updated Bayesian models so that their 
recommendations will be more accurate and up to date. The IS 520 interaction with CMR 

15 1708 is in reading models. As described in section 6. 1 above, the MLS 510 includes multiple 
learning agents and is concerned with updating models by writing them to CMR 1708. 

In addition, the CMR maintains an XML representation <rf an agent-network topology 
(also referred to as the net) of the inference agents, e.g., 1730, 1740, and 1750. This topology 
dictates the interaction and conmiunicaiion direction between pairs of inference agents 1730 

20 and 1740, for example, and is based on the findings of an "automatic building" process, which 
is the initial process of MLS off-line learning. Upon initialization, the CMR reads the net 
hyperlinks XML file, produces a net flow file, and builds a net structure object. During IM 
1710 initialization, CMR 1708 receives a request (via QRC™ agent) to supply the net structure 
to IM. This process is discussed in more detail below with respect to the scenarios of the IS. 

25 Chiring the operation of the AI system 220, the Bayesian models are updated by MLS 510, 
wherein CMR 1708 is in charge of sending messages of model updates to the IM 1710 (or 
EMs). The IMs 1710, in turn, let the relevant inference agents, via remote method invocation 
on the CMR, obtain the actual updated models, which is also discussed in more detail below 
with respect to the scenarios of the IS. 

30 Files containing the Bayesian models are organized within a directory hierarchy. The 

net structure object (e.g., a hash table) lists all hyperlinks, shared attributes of each hyperlink 
and the models coupling. Semaphores arbitrate the multiple Java threads that cause the CMR 

53 



wo 00/70481 PCT/USOO/13360 

to receive/send models. A flow-handler computes the direction of evidence flow over each 
hyperlink. This is used for involuntary evidence propagation. An example of a flow network 
is depicted in Figure 7A. In this example, the agent A2 has a downstream neighbor A2.EN2 
and an upstream neighbor being Al.DAR. 
5 6.2.6 Inference Manager (EM) 1710 

IM 1710 is the gateway for its set of agents to the rest of the server. As indicated in 
table 1500 of Figures 15A-15C, there may be several IM's. Sessions are split over these IMs 
so that each session obtains its intelligent resources from a single IM 1710. Each IM has its 
own set of inference agents 1730 and each inference agent serves all possible sessions that are 

10 served by its respective IM 1710. Each IM receives QRC"" agents from other AI sub-parts, 
such as the CMR 1708, learning managers 1202 (see Figures 12 A and 12B), AI business 
objects, which interface IS 520 to other non-AI sub-systems. As shown in table 1500, the IM 
receives QRC™ agents of the following types: 
1) user driven events, that originate from the clients; 

15 2) recommendation requests from AI business objects; and 
3) model update notifications initiating from the CMR. 

In order to handle the above requests asym^hronously and concurrently, an IM 1710 
delegates the responsibility for the actual handling of the events to its inference handlers (IH) 
1720 and 1722, and each IH runs in its dedicated Java thread. The his 1720 and 1722, for 

20 example, are maintained in a blocked size pool that permits a balanced parallel distribution of 
all requests handled by a single IM 1710. The IM keeps a representation of its net topology of 
agents, wherein different agents may be placed on different Java Virtual Machines. The IHs 
need to know about the location of these agents in order to perform global operations which 
involve more than a single agent, for instance, to cause voluntary absorption between pairs of 

25 agents, to query multiple agents in a sequence based on the Agent Hopping module, and so on. 
The structure of the net topology of agents is represented as a list of URL proxy 
addresses of all inference agents of the relevant IM 1710. Every IM uses its respective 
hyperlink file as the source of knowing which inference agents to create and deploy on line. 
Each IH, in a pool of IHs, is in charge of activating the inference agents for answering a 

30 recommendation request, A hyperlink is defined between two agents, or more precisely 
between their respective models, for which there needs to be a link of communication. 
Hyperlinks are represented in the AI system 220 both in memory inside the data 
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Structure of the IMs and also in an XML file format is shown in Figure 8. The file of Figure 8 
is read by the CMR and can either be formed manually or be generated via the MLS off-line 
model building process discussed in section 6.L8, given the proper data and domain definition 
files. As seen in Figure 8, a single hyperlink defines a connection between MODELl and 
5 M0DEL2 based on a shared set of attributes whose names is listed under SHVARS. The link 
has a coupling that is defined as the mutual information I(S1; S2) where SI is the subset of 
shared variables originating from MODELl and S2 is the subset originating from M0DEL2. 

6.2.7 Inference Handler (IH) 1722 

The IH 1722 is responsible for performing operations on the set of inference agents 
10 (e.g., lA 1730, lA 1740, lA 1750) dedicated to its IM 1710. The IH handles operations such as 
business object reconmiendation requests , which may involve a series of operations on 
different inference agents. The result returned from each inference agent could determine the 
selection of the next inference agent upon which to operate. This form of activity requires the 
IH 1722 to run asynchronously from IM 1710, keeping IM 1710 free to process fiirther 
IS incoming requests. To do so IH 1710 operates in its own dedicated thread, using IM 1710 
services (i.e., methods) to access and traverse the agent network. When handlmg QRC™ 
agents that require a reply (such as recommeridation requests arriving fr&iii AI Business 
Objects), an IH is responsible for sending the reply to the intended listeners. Since some of 
the high level operations of IH 1722 could be application dependent, it is possible to create 
20 specialized IH Java objects that inherit all characteristics from the general IH, but that also 
contain additional application or client specific capabilities. 

6.2.8 Inference Agent (lA) 1730 

Each inference agent (e.g., 1730, 1740, and 1750) is responsible to deliver predictive 
inference capabilities based on a single Bayesian model. Furthermore, each inference agent 
25 serves all on-line sessions to which its IM is in charge of delivering intelligent services. Each 
inference agent 1730 remembers the state of evidence for each such session separately, so that 
when doing predictive inference it gives out special recommendations which are personalized 
to the profile of the particular user (e.g. , user 1 10) on each session. 
The main tasks of an lA are: 
30 1) Loading its model, ensures prompt replacement of model when the CMR has updated 
it. 

2) Answering predictive queries about any attribute in its model, understands the various 
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recommendation requests through an inference API, and handles these requests for 
every session. 

3) Maintaining the state of evidence, deterministic and probabilistic, concerning the 

model, for every session. 
In order to handle multiple sessions, an lA keeps a list of inference session objects that record 
and maintain the state of evidence for each session, discussed above in section 6.2.7. 

We now describe in finer details the functionality of the lA: 

6.2.8.1 Involuntary Evidence Propagation 

With regard to the discussion of IS components in section 6.2.5 and table 1500, the 
CMR was mentioned to create the network flow file and object. This flow object governs the 
direction of flow of evidence between pairs of agents. This transfer of evidence is done in a 
passive way and hence is denoted as involuntary evidence propagation. It does not take a 
query request to cause this flow, but rather any evidence event as intercepted by an IM 1710 
gets placed on one or more inference agents, which in turn changes their state of belief, 
thereby initiating a wave of involuntary evidence propagation. 

Evidence is propagated by first converting the evidence to a probability distribution 
over one or more attributes. Both the sender and receiver of this evidence must have a set of 
shared attributes over which this distribution is well-defined. Each inference agent keeps a list 
of neighbors, including the direction of evidence flow from/to each of them. Session evidence 
(which is client driven) enters the server 162 and gets sent to the appropriate inference 
manager (e.g., IM 1710). The IM sends the evidence (via remote method invocation) to one 
or more inference agent as "Real evidence namely, evidence which directly reflects a real 
event that the on-line user 110 has generated, e.g., product order, category change, etc.. 

The real evidence is immediately translated into deterministic or probabilistic evidence, 
in the case where there needs to be multiple values placed on a single attribute. The inference 
agent then uses its EE (e.g., IE 1734) to re-compute the probability distribution over all shared 
sets with all its neighboring inference agents. The inference agent passes (i.e., propagates) 
evidence only to those neighboring inference agents which are "downstream " with respect to 
it, based on the flow structure. 

Each lA can handle three forms of evidence input: 
1) real deterministic evidence that represents a name of an attribute in a Bayesian model 
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and a single value in the domain of this attribute; 

2) real probabilistic evidence that is a probability distribution with uniform weights over a 
subset of values in the domain on which evidence is to be placed; and 

3) probabilistic evidence that is passed from one agent to another transferring beliefs 
concerning the probabilistic distribution of their shared variable(s). 

Probabilistic evidence is transferred as a list of discrete functions, whose product is the 
probability of the shared variable(s). This multi-function form is done to avoid the creation 
and transformation of high-dimensionality probability functions. 

When receiving new evidence the inference agent performs the following steps: 

1) It identifies the inference session object for which new evidence has arrived. 

2) It requests the session object to update itself, which includes the following steps: 

a) Update the state of evidence. In case the evidence is probabilistic, it is added to 
the list of probabilistic evidence. If a less recent probabilistic evidence for the 
same variable(s) exists it is replaced by the new evidence. In case of real 
evidence, the evidence is translated into probabilistic or deterministic evidence 
used to update the existing evidence state. 

b) Update the tunestamp of last arriving evidence, to the cun-ent time stamp. (Time 
stamp is a local counter indepeiKlent of the hardware clock). 

c) Empty the calculation cache, since it is no longer valid. 

d) Recalculate Gamma (see section the section on Gamma below). 

3) Propagate probabilistic evidence to each "downstream" neighbor inference agent, 
concerning the probability distribution of its shared variable(s) with this agent. This 
propagation is performed as follows: 

a) Get a snapshot of the session's current state. 

b) For each downstream neighbor, calculate the distribution of its shared 
variable(s), and represent it as a list of discrete functions that are sent as 
probabilistic evidence. The evidence will normally be sent asynchronies, but a 
synchronous mode is available as well and is used in instances where it is 
important to guarantee that evidence arrives prior to answering a query. 

6.2.8.2 Voluntary Evidence Absorption 

The involuntary evidence propagation mechanism described in the last section auns at 
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spreading information-rich evidence to as many inference agents as possible. The mechanism 
operates in a background manner and information follows in the direction of the flow structure. 
This flow direction ensures that an agent which is more coupled, i.e., has neighbors with a 
high mutual information coupling over its shared attribute sets, gets to be the sender of 
5 information to its downstream neighbors. As indicated before, this operation is independent of 
the query activity that agents undergo. 

In the event of a query request to an inference agent, it is best (for accurate predictions) 
that the agent has as much evidence as possible. As far as real evidence, this is limited to 
whatever the agent obtained from its IM 1710, which is basically all relevant information seen 

10 so far through client-triggered events. Thus, the agent relies heavily on the real evidence it has 
received. However, probabilistic evidence from its neighbors ads another dimension of 
information. The involuntary evidence flow could have delivered evidence to it, but not 
necessarily. For instance, this inference agent could have been an upstream neighbor to all of 
its neighboring inference agents, in which case it never received evidence involuntarily, even if 

15 these neighbors had supporting real evidence. 

Moreover, the quality of the evidence plays an in^>ortant role here, since evidence is 
probabilistic and thus has a certain information-content, i.e., parts Of Which are noisy. For this 
reason, there is an extended ability by which an inference agent can voluntarily absorb 
evidence from "trustworthy" neighboring agents. The meaning of trustworthy is based on a 

20 combination of the coupling of the hyperlink between the agent and its neighboring agent and 
also on the confidence in the neighbor at the time of absorption. It is also a function of the 
strength of evidence that the neighbor has. The latter being inversely proportional to the 
distance that it propagated since the time it was first placed as real evidence at some terminal 
point in the agent network. 

25 Voluntary evidence absorption is performed by an inference agent prior to performing 

one or several possible inference computations. The idea is to absorb evidence from a set of 
agents that does not include the agent's upstream neighbors, since they already involuntary 
propagated evidence to the agent. The absorption is performed recursively so that an agent X 
receiving an absorption request from agent F performs an absorption itself from its own 

30 neighbors (not including Y) prior to computing the probabilistic evidence that it returns to Y. 
In order to keep the computation efficient, a timestamp for each probabilistic evidence is kept, 
which is the value of a time counter of the agent that originally sent it (note that an agent 
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maintains a time counter per each session). 

When the absorbing agent renters a request to it sends to it the timestamp of the last 
evidence that it got from X. Upon receiving this absorption request, X performs the following: 

1) If the received timestamp is not older than the timestamp of the last evidence received 
on this session from this particular neighbor, then the agent returns with an indication 
that no absorption is necessary. Again, this is because the requesting agent already has 
the most recent belief (or evidence) based on its timestamp. 

2) Else the agent sends an absorption requests to all of its remaining neighbors. 

3) If all the neighbors returned with an indication that no absorption is necessary, the 
agent checks its cache for the requested calculation result, and returns it if it is found. 
Otherwise, after receiving all the requested probabilistic evidence, the session object is 
updated, i.e., the agent X changes its internal state due to the absorbed evidence. 

4) The requested calculation (i.e., the prediction of the shared variables with the 
requesting agent) is performed, and the result is returned to the requesting agent 7. 

6.2.9 Answering Simple Queries (Prediction, Map, Best-Explanation) 

When receiving a simple query request the lA will perform the following: 

1) Get a snapshot of the session's state, which includes all of the session's information. 
The idea here is to capture the state of the session, making the calculation that is about 
to be performed insensitive to incoming evidence or ongoing concurrent queries. 

2) If a result for the requested calculation is found in the snapshot cache, then it is 
immediately returned as the result of the computation, which saves the need to 
reactivate the inference engine and re-con5)ute the same prediction again. 

3) Remove probabilistic/deterministic evidence concerning the queried variables. Here 
one uses the abUity of a Bayesian model to have both input and output on any attribute. 
Removing all evidence on the queried variable ensures that the returned prediction is 
not simply the observed input evidence, but rather a predicted value based on what the 
model learned. Such value is clearly of higher interest to the on-line user than what it 
already has or knows. 

4) If any evidence has been removed, recalculate Gamma given the altered set of evidence. 
(See below for Gamma explanation). 

5) Perform the actual computation using the JBayes Handler (JBH). 
a) Allocate a free inference engine. 
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b) 



Create an Inference Graph, based on the engines Bayesian model. 
Set the Deterministic Evidence in the Inference Graph. 
Calculate Gamma (if it is null). 



c) 



d) 



e) 



Perform the actual computation on the inference graph using the Bucket- 
Elimination algorithm. 



5 



6) Cache the result of the calculation, only if: 

a) no evidence has arrived since the time in which the snapshot, upon which this 
calculation is based, was taken; and 

b) a more recent result for the same calculation has not been placed in the cache. 

10 6.2.10 Answering Recommendation Queries 

The returned objects supplied to the inference manager are lists of values obtained from 
a predictive query operation, and are referred to as recommendations. In the preferred 
embodiment, a recommendation has both a value and a score, for example, {Coffee, 0.56}. A 
recommendation can be given on any value of a Bayesian model's attribute. The 
15 recommendation object contains the following information: 

1) Subject of recommendation: the actual recommended value {e.g. ,^_^ 
Al BAK.BAKMUF. 10499 ) 

2) Context of reconunendation: the attribute whose value was recommended (e.g., 
Al BAK.BAKMUF) 

20 3) Lx)cal score: the score of the recommendation indicating the strength of belief in the 
specific value of the attribute, (e.g., 0.343). 

4) Context score: this is a vector of scores indicating the strength of belief in the context 
in which the recommendation is given. If the recommendation was performed after a 
certain traversal of the agent network, the context score represents the strength of belief 

25 in each traversal step, (e.g., < 0.33 , 0.56, 0.77 > ). 

5) An indication of whether any real evidence existed in the model where the 
recommendation was performed. 

A group of recommendations is kept in a modular object called a RecommendUst, Such 
a list can be collected at a given Bayesian model or during the execution of a high level 
30 reconmiendation algorithm such as the Agent Hopping algorithm. Currently, the 

reconmiendation list is sorted by context score as a primary key and local score as a secondary 
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key. Other forms of sorting are also possible. 

The inference currently handles five types of recommendation requests: 

1) Var-Recommend: A recommendation on the values of a specific variable. 

2) Shallow-Recommend: A recommendation on the attributes of a model. This 

5 recommendation is produced by performing a Var-Recommend on the Class variable of 

the model. 

3) Deep Recommend: A recommendation on a selected number of intrinsic attributes of a 
model. First the selected attributes are chosen by performing Shallow-reconmiend on 
the model, then a Var-Reconmiend is performed on all of the chosen attributes. 

10 4) Agent Hop recommend: A higher level recommendation that is produced by an 

algorithm that traverses the agent network. 
5) Agent Vote reconunend: A group of agents that can predict a given attribute are 

activated. The final recommendation result is taken as a function of the confidence of 

each of these agents and the number of agreeing agents. 
15 Ail recommendation results are returned in the form of a recommendation list. 

There are two modes of reconmiendation: 

1) PROBABILITY mode: The local score of recommended subjectjcalues is determined 
by their probabilities. 

2) DELTA mode: The local score of recommended subject values is determined by the 
20 change in their probability values given the evidence in the model, relative to their 

original probabilities without the evidence. This mode enables to concentrate on 
directions of change caused by the session evidence. In the case of DELTA mode the 
local score of a subject S is calculated as either: 
I) Relative : 

25 (Pevidence(S) - Pno-evidence(S)) / Pno-evidence(S) 

or by the formula 
7) Omega: 

Pevidence(S) * log (1/ Pno-evidence(S)) 

In the case of relative mode, filtering is performed to disregard a subject having a no 
30 evidence probability that is below than a certain threshold. This threshold is inversely 
proportional to the number of possible values of the queried attribute. Both modes aim at 
giving a higher score to attribute values for which the evidence-distribution gives a high 
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probability .while at the same time the no-evidence distribution gives a low probability. The 
omega mode is similar to an information retrieval measure of importance of word-based keys. 
6.2.11 Gamma 

Ganmia represents the total probabilistic evidence for a given Bayesian model, 
5 corresponding to a specific session state. Ganmia is represented as a list of discrete functions. 
It is calculated from a set of probabilistic evidence on different variables, and is effected by 
existing deterministic evidence in the Bayesian model. The calculation of Ganmia is performed 
as follows: 

1) Set the available deterministic evidence. 
10 2) Extract the union, Vu, of variables participating in the available probabilistic evidence. 

3) Calculate the joint probability of Vu, and represent it as a set of discrete functions, to 
avoid the creation of a single function of many variables. 

4) Invert the latter discrete functions, thus producing the denominator of Gamma. 

5) Add the discrete functions of the probabilistic evidence, thus adding the numerator of 
IS Gamma. 

6) The product of the final set of discrete functions is Gamma. 

Gamma is used in every inference computation by inserting its fimctibns" into the "buckets" 
during the Bucket-Elimination (BE) algorithm, as described in the next section. 
Data structures for GAMMA inchide: 
20 1) A list of neighbors (stating the propagation flow direction). 
.2) A list of Inference Session states. 

3) A JBayes Handler (responsible of performing the calculations). 

As mentioned in several sections above, a primary mechanism of the inference system 
520 is the ability of its distributed resoiux:es, namely the Inference Agents, to communicate and 

25 pass on their beliefs to their neighbors. Having this ability is paramount since it enables 

completing patterns of values over attributes across the domain of all models as a whole. For 
mstance, having a partial observation in the domain of model Al is still sufFicient to produce a 
prediction over the domain of model A2. This mechanism is what ties all models together into 
a single domain over which inference can be achieved. 

30 The primary mechanism of communication is the transfer of probabilistic evidence. The 

mathematical notion of transfer of probabilistic evidence is well known. Given two models, X 
and Y, with a shared attribute set {SI, S2} and suppose model Y has attributes Yl, Y2 and 
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Y3, then evidence that flows from X to Y has the following effect on the probability of any 
attribute, say Yl, of model Y: 

P*(Y1) - Z{S1,S2,Y2, Y3} P(Y1, Y2, Y3 | SI, S2) P*(S1, S2), 

5 where P*(Y1) is the new distribution after absorption of the evidence, P*(S1, S2) is the 

propagated evidence distribution based on model X and P(Y1, Y2, Y3 | SI, S2) is the 
conditional probability distribution based on model Y. 

Note that using Baye's Rule P(Y1, Y2, Y3 | SI, S2) may be expanded as P(Y1, Y2, 
Y3, SI, S2) / P(S1, S2), where the numerator is caUed the joint probability distribution of 
10 model Y. 

Gamma Formal Definition: Let Gamma(Sl,S2) = P*(S1. S2) / P(S1, S2) 

Thus we now have the general separated form (for the above example): 
P*(Y1) = Z{S1,S2,Y2, Y3} P(Y1, Y2, Y3, SI, S2) Gamma(Sl, S2), 

15 

which is expressed in terms of the receiving model's joint probability and the receiving 
model's Gamma function. ^ n^^- 

Gamma is composed of a set of numerator functions, in the example these are functions 
whose product is P*{S1, S2), and denominator functions whose product is P(S1, S2). The 
20 joint probability distribution P(Y1, Y2, Y3, SI, S2) is the core of model Y, Based on it, any 
sets of attributes in Y can be predicted by a simple operation of marginalization. 

In the preferred embodiment, the IS 520 uses the BE algorithm to do this 
marginalization. In this algorithm, probability functions whose product forms the joint 
probability distribution are initially placed m "buckets". Since the effect of evidence is 
25 localized to the Gamma(Sl, S2) term, it is possible to place Ganmia's functions, i.e., both the 
numerator and then the inverted denominator functions, into the buckets using the same rule. 
The BE algorithm's con^)utation then proceeds in a regular manner yielding the probability 
distribution of the variable YL 

Note that the additional steps mentioned below with respect to the inference agents* 
30 computations will need to take place prior to forming the buckets. These steps rely on being 
able to treat Gamma's variables as deterministic evidence variables, thereby making use of the 
important "d-separation" step that makes the computation much more efficient (d-separation is 
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a well-known concept in the field of Bayesian Networks). 

Generally, in the case of more than one neighbor to Y, the numerator functions of 
Gamma will come from various models. For instance, suppose there are 3 shared attributes, 
model Y shares SI, S2 with model X, and shares attribute S3 with model Z, then Ganmia(Sl, 
5 S2, S3) = P*(S1, S2) P(S3) / P(S1, S2. S3). If the same attribute S is shared with more than 
one model, the numerator will consist of a product of functions including probability functions 
P(S) from all relevant models. 

6.2.11.1 Gamma Object Definition 

The Ganmia object encapsulates the influence of probabilistic evidence on calculations 
10 within a given Bayesian model: 

1) Gamma = { Numerator , Denominator } 

2) Ganmia, Numerator = A set of probability functions (probabilistic evidence functions), 
received by the agent from neighboring agents. 

3) Gamma.Denominator = The joint distribution of the union of variables that appear in 
15 the Numerator (given the existing deterministic evidence). 

6.2.11.2 Gamma Initialization 

Cranmia is initialized to be Gamma = {null, null} ^^i. * . 

6.2.11.3 Update of Gamma by Evidence 

Upon arrival of new evidence the numerator or denominator of Ganmia may be set to 
20 null in order to force then- recalculation. Arrival of deterministic evidence sets both numerator 
and denominator to null. Arrival of probabilistic evidence sets only the nimierator to null, 
while the need for denominator recalculation is determined at the time of Gamma recalculation. 

6.2.11.4 Using Gamma 

The actual calculation of Gamma varies according to the type of performed operation. 
25 However, all forms of operations use the Gamma recalculation method described below, 
wherein the different forms of Gamma calculations are: 

1) Calculating Gamma for Prediction purpose. 

2) Calculating Gamma for Recommendation purpose. 

3) Calculating Gamma for Propagation purpose. 

30 The core recalculation function performed by the engine is presented in pseudo code 

format: 

recalcuiate-Gamma (current-Gamma, Probabilistic-Evidence, Deterministic-Evidence) 
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1) Obtain current-Gamma. Numerator from Probabilistic-Evidence. 

2) Let Vn be the union of all variables appearing in current-Gamma. Numerator. 

3) If (current-Gamma. Denominator ! = null ), then 

Let Vd be the union of all variables appearing in current-Gamma.Numerator. 
5 4) If (current-Ganmia. Denominator == null or Vd != Vn ), 

then current-Gamma.Denominator = JointProb (Vn | Deterministic-Evidence) 
Gamma recalculation is performed whenever a new sni^shot of an inference session is 
taken, and either the numerator or denominator of a session's Gamma equals null. This policy 
enables the inference engine to postpone Gamma recalculation to the point in time where it is 
10 actually needed, thus avoiding unneeded recalculations. 
6.2.11*5 Gamma Calculation For Recommendation 

Recommendation for an attribute, whether it comes from Var-Recommend, Shallow- 
Recommend, etc., means outputting a predicted probability distribution for the attribute. A 
Bayesian model network enables any attribute to serve as an input or an output, but not both 
15 simultaneously. Thus, prior to answering such a prediction one must be sure to remove any 
evidence at hand for the queried variable. This way, the recommendation for the variable will 
not sin5)ly be the evidence that the inference agent has for it. This is done as follows: 

1) If probabilistic evidence exists on the recommended variable, produce a marginalized 
version of the snapshot's probabilistic evidence, with respect to the variable. This gets 

20 rid of the variable from the joint probability function. 

2) If deterministic evidence exists on the recommended variable, then produce a version of 
the deterministic evidence without the evidence on the variable. 

3) If one of the above conditions has occurred, then recalculate Ganuna given the adjusted 
probabilistic & deterministic evidence. 

25 Thus for a recommendation on variable X, given a snapshot containing Deterministic & 

Probabilistic evidence, the following pseudo code (i.e., process) is performed: 
recalculate-For-Recommend ( X, Snapshot) 

(Note: This method calls the previously mentioned method recalculate-Gamma method.) 
1) X-Gamma = current-Ganama 
30 2) If (Snapshot contains deterministic evidence on X), then 
Remove deterministic evidence on X from snapshot. 
3) If (Snapshot contains Probabilistic evidera:e on X), then 
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marginalize all snapshot probabilistic functions with respect to X. 

4) If (one of the above conditions occurred ), then 

recalculate-Gamma (X-Gamma, Snapshot.Prob-Evidence, Snapshot, Det-Evidence) 
6.2.11.6 Gamma Calculation For Propagation 
5 Consider a scenario in which Model 1 propagated to Model 2 on attribute A, and at 

later point in time attempts to absorb evidence from Model 2 on A. Without care, the result 
might be that Model 1 absorbs the exact same evidence that it has propagated earlier. Thus, a 
preferred algorithm dictates that in such case Model 2 must lift evidence P*(A) that it has 
received from Model 1 prior to computing the probability distribution over A. Therefore, 
10 when propagating probabilistic evidence to- a neighboring model Ni on a set of shared variables 
Vs, if probabilistic evidence from Ni on Vs ab^dy exists, then it is removed from the 
snapshot and Gamma is recalculated. This is done to avoid the situation in which one 
inference agent passes to the another the probabilistic evidence received from that other agent. 
For propagating evidence to i^ighbor Ni, on shared variables Vs, given a snapshot of 
15 Deterministic & Probabilistic evidence, the following pseudo code (i.e., process) is performed: 
recalculate-For-Propagation (Ni, Vs, Sni^hot) 

(Note: This method calls the previously mentioned method to recakulate-Gamma.) 

1) X-Gamma = current-Gamma 

2) If ( Snapshot contains Probabilistic evideiK:e on Vs that was originated from Ni), 
20 then, remove it from snapshot . 

3) recalculate-Gamma (X-Gamma, Snapshot.Prob-Evidence,Snapshot.Det-Evidence) 
6.2.12 Inference Session 

An inference session object (ISO) maintains the state of a session, including its 
evidence. Gamma fimction, and calculations cache. The ISO is also responsible for keeping its 
25 local time counters (since sessions are independent), so each ISO keeps the time stamp of its 
last arriving evidence. Tte data structures used for ISO include: 

1) the contents of the real evidence; 

2) a list of deterministic evidence; 

3) a list of probabilistic evidence; 

30 4) a cache of previous calculations (including Gamma); and 

5) a list of previously handled events. 
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6.2.13 JBayes Handler 

The JBayes Handler (JBH) is responsible for performing all calculations concerning a 
single Bayesian model. JBH maintains a pool of lEs (e.g., IE 17340) which perfonti the actual 
calculations - predictions, MAP decisions, Maximimi Expected Utility and Gamma 
5 calculations. The JBH also performs other special purpose tasks that involve direct interaction 
with the EE. In the preferred embodiment, a public domain distributed software named 
JavaBayes is extended and used as the basis for the inference engine. For instance, such 
extensions include the ability to use probabilistic evidence, to predict multiple attributes 
simultaneously and to perform dynamic simpUfication of computations as part of a tradeoff 
10 with the available memory resoim:es. The data structures used for JBH include a pool of 
engines of a specific model, 

6.2.14 Inference Engine (IE) 

An inference engine (e.g., IE 1734) is the primitive module (or component) for 
performing various process involved in making an inference. Given a Bayesian model, a state 

15 of evidem:e (or observed values) for any subset of attributes of the model, and given a query 
request which may be a request to predict the probability distritnition of ft single or multiple 
attributes, a Maximum Aposteriori Probability (MAP) classification request, or a Maximum 
Expected Utility (MEU) decision, the engine proceeds with the requested computation. 
The basis of the IE, computations are based on the Bucket Elimination Algorithm, 

20 previously mentioned, Exteirfed use of standard ideas from probability theory as well 
concepts of '^d-separation" are used to make computations more efficient. The low level 
confutations of the inference system 520 are: 

1) the margmal posterior distribution of a single variable; 

2) the marginal joint distribution of a set of variables; 
25 3) the MAP of a set of variables; and 

4) the MPE (Most Probable Explanation) of the entire model. 

These low level computations are performed using the Bucket Elimination Algorithm, 
with the extension of using Gamma fiinctions, and the "Killing Algorithm", which optimizes 
the tradeoff between accuracy and computational resources such as memory and CPU time, 
30 All of the listed computations are performed similarly using variations of the extended Bucket 
Elimination algorithm. 
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6.2.14.1 Extended Bucket Elimination (BE) Algorithm 

As mentioned above, IS 520 adds extensions to the standard package JavaBayes to 
enable additional computational modes. The standard JavaBayes software implements the BE 
algorithm. In order to reduce the calculation time when doing inference (e.g. prediction) the 

5 standard JavaBayes uses the interdependencies information inherent in the graphical structure 
of the network in order to determine which variables are relevant, i.e., have mfluence on the 
queried variable. This is done in the constructor of a class called "Ordering", through a call to 
a method alljiffecting (objective Judex), which is in the Java class DSeparation. The method 
is based on the standard concept of d-separation, see J. Pearl, Probabilistic Reasoning in 

10 Intelligent Systems, (Morgan Kaufmann Publishers 1988). 

The extensions to the BE algorithm arise from the foUowmg needed capabilities, which 
were missing in the JavaBayes package: 

1) predicting joint probability distributions for multiple attributes, which necessitates 
finding the affecting variables to all of the variables to predicted, and 
1 5 2) handling probabilistic evidence in addition to deterministic evidence. 
Ii^mts to the extended BE algorithm include: 

1) a set of queried variables (possibly containing a single variable)^ 

2) the Bayesian model's determmistic evidence; 

3) a Gamma object contaming the Garoma functions, only if probabilistic evidence exists 
20 in the model; and 

4) iiq)ut modes indicating the type of prediction (e.g., posterior distribution, MAP or 

MPE). 

Outputs of the extended BE algorithm mchide: 

1) When computing the marginal posterior distribution of a single variable, a single 
25 discrete fiiKtion is returned. 

2) When computing a marginal joint distribution of a set of variables, a set of discrete 
functions is returned whose product equals the requested jomt probability. 

3) When conq)uting the MAP of a set of functions, the most probable combination of 
values is returned (A Vector of {Variable, Value} pairs). 

30 4) When computing the MPE of a model, the most probable combination of variable 
values is returned (A Vector of {Variable, Value} pairs). 
The extended BE algorithm includes the following steps: 
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Step 1 : Determine the set of "affecting variables" with regard to the queried variables, 
based on the deterministic evidence (observations) and Gamma. The set of "affecting 
variables" consists of the union of variables that are not d-separated from at list one 
queried variable. Variables for which probabiUstic evidence exists are treated as 
observed as far as d-separation is coiK^emed. 

a) The standard d-separation algorithm can be used as is, in the prediction of joint 
probability and the existence of probabilistic evidence. The only required 
modifications are in its form of activation, as explained above. The 
"participating variable" set is the set of variables that will participate in the 
bucket elimination phase. This set is defined as the union of the "affecting 
variable" set and the set of variables participating in Gamma, 

Step 2 : Filter Ganmia functions as a result of d-separation. Functions appearing in the 

denominator that do not involve any of the "affecting variables" are removed from 

Gamma. 

Step 3 : Produce an ordered set of variables, and a set of functions that will participate 
in the bucket elimination phase. The set of variables is mitialized to the "participating 
variable" set, induced in the previous step. The function set i^ 4nitialized to include the 
conditional probability tables (CPTs) of the "affecting variables" and the set of filtered 
Gamma functions. The above sets are induced in an iterative manner, wherein each 
iteration the following is performed: 

a) The algorithm attempts to create an ordering of the current variable set based on 
a "gr^h moralization" algorithm (see R. Dechter, Bucket Elimination: A 
Unifying Framework For Probabilistic Inference, Uncertainty in Artificial 
Intelligence UA196, 211,219 (1996). In the preferred embodiment, the 
moraUzation algorithm has been altered to receive a set of functions, replacing 
the model CPTs. As a result. Gamma functions are taken into account when 
inducing the order of variables. The altered moralization algorithm receives a 
set of variables and a set of functions, from which it builds a "moralization 
graph". In the graph, each variable is represented by a node. Two nodes are 
linked if their variables appear in a common function. After initialization, the 
altered moralization algorithm chooses, in an iterative manner, the node having 
the minimal number of links. It eliminates it and links all of its neighbors to 
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one another. The returned order of variables is the order of elimination. Since 
the process of node elimination corresponds exactly to the BE algorithm, which 
is executed at some later time on the same ordered set of variables, it is possible 
to identify the maximiun bucket dimensionality at this early stage of 
5 moralization. Our "kiir extension, explained below, uses this to identify when 

a certain bucket is about to exceed a certain determined threshold and then kills 
the variable. 

b) If during the creation of the moralization graph, one of the graph nodes exceeds 
a certain threshold known as the "maximum bucket dimensionality**, the 

10 ordering attempt fails. The maximum bucket dimensionality represents the 

maximal allowed size (number of elements) in the "Lambda" function, which 
every bucket produces. This size is equal to the product of the cardinality of all 
variables of all functions in the bucket. The dimensionality of a variable's node 
in the moralization gr^h is equal to the dimensionahty of its bucket in the 

1 5 bucket elimination phase. 

c) If the conq)utation of ordering succeeded, the iterative process stops, and the 
ciurrent ordered variable set and function set are dK>sra,ta be used in the bucket 
elimination phase. 

d) Otherwise a **kiir is performed on one of the graph-nodes whose dimensionality 
20 exceeded the allowed threshold. The killed variable is chosen, in the preferred 

embodiment, to be that of the highest dimensionaliQ^, but other heuristics may 
be considered as well. 

e) Once a variable is "killed", it is removed from the ciurent variable set. All the 
CPTs and Gamma functions containing the killed variable are marginalized with 

25 respect to it while assuming it has a uniform distribution (marginalization is the 

process of taking the conditional expected value). 

4) Step 4 : When creating the buckets for the BE process, a bucket is created for each 
member of the ordered variable set, produced in the previous step. All members of the 
produced function set (including the Gamma functions) are inserted into the buckets 

30 according to the standard BE algorithm. 

5) Step 5 : The buckets are also reduced according to the standard BE algorithm, wherein 
in each step, the current last bucket is reduced into a Lambda function that is inserted 
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into one of the remaining buckets. The only exception concerns the case of a joint 
probability con:q)utation. In this case, the reduction of buckets is terminated at the stage 
where the only remaining buckets are those of the queried variables. At this stage, the 
reduction stops and the returned result is the union of functions foimd in the buckets of 
5 the queried variables. Although the joint probability is equal to the product of the 

function set, it is kept in the form of a function set to avoid the creation of a function of 
high dimension. When computing the distribution of a single variable, the result 
function is returned after normalization. 

6) Step 6 : In case of a MAP or MPE calculation, a backward maximization is performed 
10 to induce the most probable value of each variable. 

For a detailed example of an inference agent computation, consider the Bayesian 

network model 1800 of Figure 18A, where the valxie ranges of the model variables are: 



15 



1) 


Range of 


A = 


{al, a2, a3} 


2) 


Range of 


B = 


{bl,b2,b3, M} 


3) 


Range of 


C = 


{cl, c2. c3, c4. c5} 


4) 


Range of 


D = 


{dl, d2, d3} 


5) 


Range of 


E = 


{el, e2, e3, e4} 


6) 


Range of 


G = 


{gl, g2, g3, g4, g5} 


7) 


Range of 


H = 


{hi, h2, h3} 


8) 


Range of 


I = 


{il. i2, i3} 


9) 


Range of 


Q = 


{ql. q2, q3} 




This example focuses on a case where 



20 



following state of the model: 

DptftrmiTii stic Evidence : H = hi 
25 ProbabUistic Evidence : P*(B), P*(D) 

nflTTimfl numerator: P*(B), P*(D) 

namma denominator: P1(B). P2(B,D) 

Max Dimensionalitv Threshold = 15 
Notice that die product of functions in the denominator equals the joint probability of B, D in 
30 model 1800; also notice that the existence of P2(B,D) indicates that B and D are not 
independent, as can easily be seen by viewing model 1800. 

Working the example through the extended BE algorithm: 
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1) Phase 1: Detennimng the set of "affecting variables": 

a) Before activating the d~separation algorithm, set the variables having 

probabilistic evideiK:e, namely B and D, as observed just for the sake of d- 
separation. (The observation settings are lifted right after D-separation). 
5 b) After activating the d-separation algorithm the "affecting variable" set is 

determined to be: { A, D, G, E, Q }. The deterministic evidence on H caused 
the elimination of H and I while the probabilistic evidence P*(B) on B caused 
the elimination of B and C. 
The "participating variable" set is {A, D, G, E, Q, B }. 
10 2) Phase 2: Filter Gamma functions. 

After filtering Gamma functions that involve only variables in the set {A, D, G, E, Q}, 
Gamma is then set to: 

nflmma numerator: P*(B), P*(D) 
(ramma denominator: P2(B,D) 
15 Notice that P1(B) has been filtered out, since it involves only a variable which is not an 
"affecting variable", namely B. 

3) Phase 3: Producmg an ordered variable set „ , ' 

a) Initialization: The ordered variable set is mitialized to the "participating 
variable" set, namely { A, D, G, E, Q, B }; the function set becomes { P(A| 

20 B,D,G), P(D|B,E), P(G|E), P(E), P(Q|A,H), P*(B), P*(D), P2(B,D) }. 

b) An ordering of the variables is attempted usmg the graph-moralization 
algorithm. During moralization, the node of variable E contains variables {E, 
D, B, G}, so that its dimensionality (240) exceeds the maximum Bucket 
DimensionaUty, which is set to IS. As a result, variable G is chosen to be 

25 killed (since it has the highest cardinality 5). The current sets after killing are: 

i) participating variable set = {A, D, E, Q, B}. 

ii) Function set = 

{P(A| B,D), P(D|B,E), P(E), P(Q|A,H), P*(B), P*(D), P2(B,D)}. 
Note the marginalization of functions P(A | B, D, G) and P(G | E) with respect to G are: 
30 i) P(A I B,D,G) => P(A | B, D) = Eg P(A | B,D,G) 

ii) P(G|E)=:>IgP(G I E) = 1 
Where Eg stands for a summation over all possible values of G. 
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c) An ordering based on the new sets is attempted. During moralization, the node 
of variable E contains variables {E, D, B}, although smaller then in the previous 
step, its dimensionality (48) still exceeds the threshold. As a result, variable E 
of highest cardinality 4 is killed. The current sets after killing are: 

5 i) participating variable set = {A, D, Q, B} 

ii) Function set = 

{P(A| B,D). P(D|B), P(Q|A,H), P*(B), P*(D), P2(B,D)} 
Notice that P(E) has been completely eUminated. 

d) An ordering based on the new sets is attempted. During moralization the node of 
10 variable B contains variables {B, A, D}, although smaller then in the previous 

step its cardinality (36) still exceeds the threshold. As a result variable B of 
highest cardinality 4 is killed. The current sets after the killing are: 

i) participating variable set = {A, D, Q} 

ii) Function set = {P(A| D), P(D), P(Q| A,H), P*(D), P2'(D)}. 
15 At this stage the moralization algorithm has completed successfully, so the final 

ordering is = { D, A, Q }. 
4) niase 4: Creating the buckets for the bucket elimination phase:'""' 
The produced buckets are: 



a) Bucket D 
20 b) Bucket A 

c) Bucket Q 



P(A|D), P(D), P*(D), P2'(D) 
P(Q|A) 
en]?)ty 

Notice that in Imcket A, P(Q | A,H) has been reduced to P(Q | A) by substituting the 
deterministic value of H. 

5) HiaseS: Performing the bucket elimination phase: 
25 a) Stepl : Bucket A: P(Q | A), X(A). 

Bucket Q: empty 

b) Step2: Bucket Q: HQ) 

c) Steps : The product of fimctions in bucket Q, that is X(Q) is normalized, such 
that Norm(MQ)) is returned as the result of the algorithm. 

30 6) Hiase 6: This phase is not run in this example since it is a prediction calculation and 
not a MAP or MPE. 
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6.2.15 DRV Inference Agents or Models 

As described with respect to the learning agents of the MLS 510 in section 6.1, DRV 
models are used in the AI system 220 for the purpose of predicting the probability of NULL 
value for each attribute in any model. This is because a NULL value has an important and 
5 strong influence over the prediction accuracy. However, a NULL value can never be entered 
as a deterministic value, since as long as a session is active it is not possible to state that a user 
entered NULL for an attribute (i.e. has not selected that category of product). The present 
invention includes a process for updating update any model's belief concerning any of its 
attributes taking the value NULL. 

10 The basis of this prediction is information that contains the entry time to categories in a 

Web site, as an example. For instance, consider attribute ALVEG in model Al ISKX) of 
Figure 19. The process predicts the probability that a person wiU not select Al.VEG based on 
the number of times that the person has visited the Al category and still has not selected 
Al.VEG. The premise here is that a user is less and less likely to select Al.VEG as the 

15 number of times that the user enters Al and does not choose Al .VEG uicreases; 

A DRV agent handles predicting P(A1.VEG = NULL) based on evidence which 
reflects the number of times the user entered the parent category Al .^'^Alf iexiau^ of a DRV 
agent DRV.Al associated with regular Agent Al is shown Figure 10, but also applies in this 
case. As seen, there are two types of attributes in a DRV model: the TIME attribute 1002 and 

20 the NULL attribute 1004. The NULL attribute 1004 takes the value {NULL .OTHER} where 
an OTHER indicates that the user has selected something from the related category while a 
NULL signifies it has not selected. The TIME attribute 1002 takes the values {0, 1, M}, 
where M is some fixed number. The time attribute's value x refers to the time that the 
associated category was entered relative to the entry time of its parent category. For exan^)le, 

25 placing deterministic evidence of the form: DRV.Al.VEG.TIME = 3 means that the user has 
entered the Al.VEG category after he entered the Al category 3 times. An example of such a 
sequence of activity is: A3, Al, Al.PKG, Al, Al.FRT, Al. Al.SEA. At this point in time, 
the user entered Al 3 times. Therefore, the likelihood of the user entering Al.VEG will be 
low. 

30 The inference system distributes sxich time evidence to all relevant DRV models based 

on activity events called <CATEGORY_CHANGE> events. These events contain time 
sequence of category entries, as shown and described above. The format 2000 of this event is 
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shown in Figure 20. 

The IS 520 uses the DRV models 1800 to predict the NULL attribute. The DM 1710 
distributes evidence based on category change events to its DRV L\s. In the preferred 
embodiment, evidence is always placed on the TIME attribute and never on the NULL 
5 attribute. For instance, if a current session enters subcategory PKG under model Al after 
having entered category Al twice, then the following evidence is placed: DRV.Al.PKG.TIME 
= 2 (1002 of Figure 10). The DRV. Al agent 1000 then computes for each of its DRV.NULL 
attributes one of the following, depending on where the user is currently (as indicated by the 
last CATEGORY CHANGE event received by the IM), without loss of generality we display 
10 it for DRV. Al. PKG: 

1) Given evidence DRV.Al.PKG.TIME = Tcurrent, 

a) if based on the last CATEGORY CHANGE event it is determined that the user 
is in category Al, then compute the conditional distribution: 
P* = P(DRV.A1.PKG.NULL = NUIZ | TIME = Tcurrent), but 
15 b) if the user is outside category Al, then compute the joint distribution: 

P* = P(DRV.A1.PKG.NULL = NULL, TIME > Tcurrent) 

2) Propagate as evidence this P* to all "regular" models (non-DRV) having attribute 
Al.PKG. 

3) Upon receipt, a regular model sets P(A1.PKG = NULL) == P* , and normalizes the 
20 probabilities for the remaining values of Al.PKG with a total of 1 - P*. 

Based upon the above algorithm, probabilistic evidence on NULL is placed based on 
the DRV model's 1800 confidence, which is directly related to the category changes exhibited 
so far in the current on-line session. 

6.2.15.1 Learning DRV models 

25 The DRV models are learned using the same Machine Learning System that learns the 

entity Bayesian models (see also section 6.1 on MLS 510). However, instead of using the 
serial, dot files, the DRV models utilize category-change information, which is still represented 
in a serial manner. A module converts this serial stream of category-change information into 
cases for attributes NULL and TIME by scanning the number of times each category was 

30 visited, as seen in the serial stream. When the end of the session activity stream is reached, 
letting the TIME attribute take the last entry time relative to the parent category (discussed 
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more detail in MLS section 6.1.9). From these cases, the DRV model 1800 is learned using 
the same off-line process as the regular, entity Bayesian models. The learned DRV model can 
then be used by a DRV Inference Agent. 
6.2.16 IS 520 API 

5 IS 520 can be viewed as an AI system 200 resource that receives query requests and 

returns sets of induced recommendations. The available query forms are represented by a set 
of APIs, which are activated by sending QRC™ agents, to the IS. The result of each API is 
returned in the form of a Reply Object, containing a set of reconmiendation descriptions. IS 
520 supports the following five basic APIs: 
1 0 1) Var- Agent-Recommend: 
Parameters: 

a) agentName (String) = name of queried agent. 

b) attributeName (String) = name of queried attribute within the agent. 

c) maxItemsNum (int) = maximum number of returned recommendations. 

15 d) evaluationCriterion (String) = name of the evaluation criterion applied by IS. 

Return: 

e) A RecommendationList reply object. 
2) Shallow- Agent-Recommend: 
Parameters: 

20 a) agentName (String) = name of queried agent. 

b) maxItemsNum (int) = maximum number of returned recommendations. 

c) evaluationCriterion (String) == name of the evaluation criterion applied by IS. 

Return: 

d) A RecommendationList reply object. 
25 3) Deep- Agent-Recommend: 

Parameters: 

a) agentName (String) = name of queried agent. 

b) maxItemsNum (int) = maximum number of returned recommendations, 

c) evaluationCriterion (String) = name of the evaluation criterion applied by IS. 
30 d) maxAttributes (int) = maximum number of recommended attributes within the 

queried agent. 

e) maxAttribute Values (int) = maximum number of recommended values of each 
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attribute. 

Return: 

f) . A RecommendationList reply object. 
4) Agent Hop Reconunend: 
5 Parameters: 

a) triggerCode (String) = AI code name of a lowest level entity, e.g. a product. 

b) maxItemsNum (int) = maximiun number of returned recommendations. 

c) HoppingStrategy = Topological or Logical hopping 

d) evaluationCriterion (String) = name of the evaluation criterion applied by IS. 
10 e) MaxNumberOfHops (int) = upper bound on nimiber of hops allowed 

f) BranchingFactor = the number of neighbor agents to consider when at an agent 
point. 

g) maxAttributes (int) = maximum number of recommended attributes within the 
queried agent. 

15 h) maxAttribute Values (int) = maximum number of recommended values of each 

attribute. 

i) AllocatedTime (int) = max permitted time before a rcturn result. 

Return: 

j) A ReconmiendationList reply object. 
20 5) Agent-Vote-Recommend 
Parameters: 

a) attributeName (String) = name of queried attribute. 

b) maxItemsNum (int) = maximum number of returned recommendations. 

c) evaluationCriterion (String) = name of the evaluation criterion applied by IS. 
25 Rrtum: 

d) A RecommendationList reply object. This is the decision as obtained from a 
cooperative decision of several agents, 

6.2.16.1 QRC™ Agent Format of APIs 

All APIs are activated by sending a QRC™ agent of tag 
30 "INF RECOMMEND^EVENT" to the IS. The sent QRC™ agent must contain the following 
elements: 
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1) MODEL - indicating the name of the queried agent; 

2) SUBJECT - indicating what is being queried, which should either one of the following: 
a) The name of an attribute of the queried agent, indicating that this is a 

Var AgentRecommend . 
5 b) The string "Shallow-Agent-Recommend", indicating that this is a 

ShallowAgentRecommend. 
c) The string "Deep- Agent-Recommend", indicating that this is a 
DeepAgentRecoramend. 

3) MAX ITEMS NUM - indicating the maximum number of remmed recommendations. 
10 4) EVAL CRTT - indicating the evaluation criterion used by the IS, which should be one 

of: 

a) The String "PROB_RECOMMEND_TYPE" . 

b) The String «DELTA_RECOMMEND_TYPE" . 

When activating the Deep-Agent-Recommend API the QRC™ agent must also contain 

15 the following fields: 

1) MAX ATTRIBS - indicating the maximum number of recommend[ed attributes within 

the queried agent. 

2) MAX ATTRIB VALS - indicating the maximum number of recommended values in 
each recommended attribute, 

20 Examples of QRC™ agents demonstrating the QRC™ agent structure of each API shown 

as follows: 

1) Var-Agent-Recommend: Structure 2110 shown in Figure 21 A. 

2) Shallow-Agent-Recommend: Strucmre 2120 shown in Figure 21B. 

3) Deep-Agent-Recommend: Structure 2130 shown in Figure 21C. 

25 4) ShaUow-Ndghborsr-Agent-Recommend: Strucmre 2140 shown in Figure 21D . 
6.2 J6.2 Result of Recommendations 

The recommendations are returned in the form of a reply object of class 
RecommendList (see Figure 22). which represents a collection of recommendations, induced 
by IS 520. Each recommendation element is an object of class Recommend containing the 

30 following fields: 

1) Subject: indicating the subject of reconunendation ( e.g., "Al.Bl.Cr , "A2.B2'', 
etc.). 
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2) SubjectType: indicating the type of the recommended subject (e.g., "product", "B 
level category", etc.). 

3) Context: the context in which this recommendation was done (e.g., the category in 
which this subject was recommended). 

5 4) LocalScore: the relative score (e.g., probability) of this subject within its context. 
5) ContextScore: the score of the context of the recommended subject. 

The contents of the RecommendationsList object are translated to outer "users** (such 
as Business Objects) via a set of defined interface methods. An example 2200 is given in 
Figure 22, which presents the returned ReconunendList information 22(K) when activating a 

10 "Shallow-Neighbors- Agent-Recommend" API on agent Al (see Figure 19), using the QRC™ 
agent strucmre 2150 of Figure 21E 

The returned ReconunendList 2200 of Figure 22 contains a variety of information. 
First, note that the total number of items returned in the table is not more than 10, as specified 
by <MAX_ITEMS_NUM VALUE = 10 > in the structure of Figure 21E. Next, note that 

15 there are only two types of Contexts, namely, Al.BRD and Al.FRT. This adheres to the 
specification of <MAX_NEIGHBORS VALUE = 2 / > in Figure 21E. Also, for the first 
context, there are 2 items whose subjects are Al.BRD.BRDPIZ amd AkBRD.BRDCRM. The 
size bemg "2" adheres to the max value as specified by < MAX_NEIGHBOR_ATTRroS 
VALUE = 3 / > . This is also the case for the second context that has 3 items whose subjects 

20 are Al.FRT.PROJAR, Al.FRT.FROPA and Al.FRT.PROFGR. 

6.2.17 IS Configuration Modes 

Functional: The configuration modes control the following functionality: 

1) Operational modes: 

a) Asynchronous/Synchronous propagation of evidence 
25 b) Asynchronous/Synchronous handling of QRC™ agents by the IM 1710. 

Asynchronous handling is achieved by a pool of Inference Handlers (IH) each 
operating in its dedicated thread, 
c) The default number of EEs dedicated to each lA. Each engine requires memory 
for its model. Engines are preferably not ORB objects, so it is possible for 
30 them to share the same model, thereby saving memory. 

2) Compression modes: 
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a) Minimum length for compression 

b) Minimum compression ratio 

c) Minimum length of series to compress 

3) Technical fields concerning location of input and log files 
5 4) Printing modes that determine which information will be spooled to the inference log 
file. 

The configuration is implemented as static Java variables in the AI Configuration 
object. This AI configuration is accessible to all objects that run in the current Java VM. 
6.2.18 Scenarios of the Inference System 
10 For illustrative purposes, several scenarios of IS 520 are discussed below. 

6.2.18.1 Inference Manager Initiation 

1) The initiator is the intelligence system 200 server 162. 

2) A QRC™ agent "Start New Inference Manager" is sent to IM, and no reply is needed, 

3) A new IM object is constructed. 

15 4) IM sends CMR a QRC™ agent "Supply Model Net", and waits for reply. 

5) CMR sends a reply object containing, a list of model objects & neighbors. 

6) IM creates an internal agent graph. 

7) IM creates the real agents (i.e., ORB objects). 

6.2.18.2 Inference Manger Update 
20 1) The initiator is CMR. 

2) A QRC™ agent "Update a model" is sent to IM, no reply needed. 

3) IM receives an IP reference to the new model. 

4) IM sends the new model to the corresponding agent lA. 

5) lA switches to its new model while previous session object still use the older model 
25 version. 

6.2.18.3 Propagation of user driven evidence 

1) The initiator is, for example, client 154, as result of user action . 

2) A QRC™ agent "Product Order Event" is sent to IM, no reply needed. 

3) IM finds the affected agent/s and propagates to them the "real" evidence. 

30 4) The affected agent/s lA, receives the "Real" evidence and updates its corresponding 
session object IS. 
5) IS performs the following: 
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a) Updates its evidence state (Real, Deterministic, Probabilistic evidence). 

b) Update the timestamp of last arriving evidence, to the current time stamp, (time 
stamp is a local counter independent of the clock). 

c) Have the calculations cache point to an empty list (Hash-Table). 

d) Recalculate Gamma, and store it in the cache. 

6) Get the Session's current Snapshot. 

7) Propagate probabilistic evidence to each downstream of lA, as follows: 

a) Calculate the distribution of its shared variable/s with lA, (The distribution is 
kept as a list of functions, to avoid functions of large magnitude). 

b) Propagate the probabilistic evidence to the downstream agent, in an 
unsynchronized/synchronized manner. 

8) The downstream agent lA receives the probabilistic evidence, and performs steps (4 to 
7), excluding the updating of real evidence. 

9) The propagation process terminates when all agents have propagate their evidence to 
all their downstream neighbors. 

6 •2.18.4 Query Request from Rule Evaluation System 

1) The initiator is a AI rule evaluation system. „ ■ 

2) A QRC™ agent "Perform Inference (^ery" message is sent to IM, and a reply is sent 
after calculation. 

3) IM 1710 allocates a free inference handler (e.g., IH 1710) and sends it the contents of 
the QRC™ agent, including the requester's addresses. 

4) The IH, operating in a dedicated thread, interprets the query, and selects the initial 
agent with which to start the query. 

5) IH performs a series of steps, wherein in each step the currently selected agent (e.g., 
lA 1730) is requested to perform a single or series of operations, such as: 

a) Evidence absorption from neighbors. 

b) Sinq)le computations such as: Posterior Probability, Classification (e.g., MAP), 
and Most Probable Explanation (MPE). 

c) More complex computations such as: "Highest Peek" and "Delta 
Classification". 

6) Based on its computations at each step, the IH can shift its attention to a different lA, 
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requesting it to perform further calculations. 

7) The query result is calculated by a target agent or agents that are reached through this 
series of steps. 

8) Upon achieving the result, Ui returns it in a reply object to the initiating business rule 
5 component, and becomes ready for further incoming requests. 

6.2.18.5 Simple Computation (Prediction, MAP, MEU) by Inference Agent 

1) The initiator is an IH, as part of performing the "Query Request** scenario. 

2) The Inference Agent(e.g., lA 1730) receives the requested computation request. 

3) lA attains a snapshot of the corresponding session. 

10 4) If a result for the requested calculation is found in the snapshot's cache, then it is 
returned as the result of the computation. 

5) The probabilistic/deterministic evidence corresponding to the queried variables is 
removed, and the snapshot's Gamma is recalculated. 

6) Perform the actual computation usmg the Java Bayes Handler (JBH): 
15 a) Allocate a free inference engine (e.g.. DE 1734). 

b) Create an inference graph, based on the engines Bayesian model. 

c) Set the deterministic evidence in the inference graph. 

d) Calculate Gamma (if it is null). 

e) Perform actual computation using the Bucket-Elimination algorithm. 
20 7) Cache in the result of the calculation, only if : 

a) No evidence has arrived since the time in which the snapshot, upon which this 
calculation is based, has been taken. 

b) A imore recent result for the same calculation has not been placed in the cache. 
8) Return the result to the initiating IH. 

25 6.2.18.6 Evidence Absorption 

1) The initiator is IH (it is possible that lA will do it implicitly before each query). 

2) The lA receives a request to absorb all evidence from its non-downstream neighbors. 

3) lA requests each of its non-downstream neighbors to supply it with probabilistic 
evidence on their mutually shared variables, by sendmg it an absorb request. 

30 4) Each such neighbor then absorbs evidence from its non-downstream neighbors, 

calculates the requested probabilistic evidence and returns it to the requesting agent. 
5) This re^.irsive process terminates when the initial lA has completed absorption of 
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evidence from all of its neighbors. 
6.2.18.7 Session Termination 

1) The initiator is AI system 200, (external, client 154 driven). 

2) A QRC™ agent "Session Terminated" is sent to the IM, and no reply is necessary. 
5 3) IM broadcasts the session termination message to all its agents. 

4) Each lA, removes the session object. 
6.2.19 Examples Of Evidence Propagation 

For illustrative purposes, several examples of evidence propagation are included below. 

6.2.19.1 Overlapping Probabilistic Evidence. 

10 Referring to the example of Figure 23, Model 1 2310 gets (and has) probabilistic 

evidence from Model 2 2320 and Model 3 2330. As a resxilt. Model 1 has probabilistic 
evidence P*(A,B) and P*(B,C), with overlapping on variable B. Both functions will be used in 
the calculations so tiiat Gamma = (P*(A,B) P*(B,C) ) / (P(A,B.C). 

6.2.19.2 Overriding Probabilistic evidence 

15 An example of overriding evidence is shown m Figure 24, wherein Model 1 2410 

shares variable set A with Model 2 2420 and Model 3 2430. Suppose that both Model 2 and 
Model 3 propagate probabilistic evidence on variable A. There are Vaitcws ways to form this 
single P*(A). For instance, let P*(A) be the linear combination of both functions with weights 
equaling the model-dependent confidence, where confidence is a function of the coupling (i.e., 

20 the mutual information of the set A with respect to the no-evidence distribution) and the 

distance between the evidence-distribution of A and the no-evidence distribution of A (any of 
the standard distance functions may be used, e.g., the LI -distance). 

In the current implementation, the algorithm lets P*(A) be the most recently propagated 
probabilistic evidence, namely, the most recently obtained evidence over A overrides any prior 

25 probabilistic evidence on A. 

6.2.193 Propagating Probabilistic Evidence On Observed Variables. 

An Exan^Ie of mixed deterministic and probabilistic evidence is shown in Figure 25, 
wherein Model 1 2510 propagates probabilistic evidence P*(A,B) to Model 2 2520. Since 
Model 1 2510 received real evidence on A 2530, the probabilistic evidence sent to Model 2 

30 2520 contains only a function P*(B). Notice that the evidence on A is sent to Model 2 in the 
form of real evidence by the IM of Model 1, thus there is no need for Agent A to send it to 
Model 2. 
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6.2.19.4 Preferring Probabilistic Evidence 

Referring to Figure 26, probabilistic evidence that emanates from real evidence 2630 is 
preferred over propagated probabilistic evidence. That it, real evidence on two values of A is 
translated into probabilistic evidence on A. In the preferred embodiment, in Model 1 2610, 
5 this evidence overrides probabilistic evidence propagated from Model 2 2620. 

The invention may be embodied in other specific forms without departing from the 
spirit or central characteristics thereof. The present embodiments are therefore to be 
considered in all respects as illustrative and not restrictive, the scope of the invention being 
indicated by appending claims rather than by the foregoing description, and all changes that 
10 come within the meaning and range of equivalency of the claims are therefore intended to be 
embraced therein. 
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Claims 

1 1. An intelligent computer system for making real-time recommendations and predictions 

2 within the context of a domain, said system comprising: 

3 A. at least one application server linked to a first storage media, having a plurality 

4 of Bayesian models stored therein, wherein each Bayesian model represents an 

5 entity within said domain and includes one or more entity attributes; 

6 B. at least one client device disposed between said at least one application server 

7 and a device of a user; 

8 C. an intelligence application module hosted on said application server and 

9 responsive to system events received from said client, said intelligent program 

10 including: 

11 i. a set of domain related rules stored in a rules database; 

12 ii. an artificial intelligence module configured to dynamically update said 

13 Bayesian models as a function of said system events and domain related 

14 information; 

12. An intelligent computer system as in claim 1, wherein said Bayesian models are 

2 logically related in a Bayesian model network. 

1 3. An intelligent computer system as in claim 2, wherein said Bayesian models logical 

2 relationships are statistical relationships. 

14. An intelligent computer system as in claim 2, wherein said Bayesian models logical 
2 relationships are in the form of hyperlinks. 

15. An intelligent computer system as in claim 1 wherein said Bayesian models are 
2 manually generated. 

16. An intelligent computer system as in claim 1 wherein said Bayesian models are 
2 iiq)resented in XML format. 
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1 7. An intelligent computer system as in claim 1 wherein said domain includes a plurality of 

2 concepts and wherein a concept is represented over one or more of said Bayesian models. 

1 8, An intelligent computer system as in claim 7 wherein a concept represented over a plurality 

2 of Bayesian models is represented at different levels of resolution in different ones of said 

3 Bayesian models. 

1 9. An intelligent computer system as in claim 7 wherein said domain is an e-conmierce 

2 domain and one or more of said concepts represents a product or a service. 

1 10. An intelligent computer system as in claim 1 wherein said artificial intelligence module 

2 includes an inference module hosted on said application server and configured to generate 

3 predictions and reconmiendations as a function of: 

4 i) attribute value predictions across all of said Bayesian models over time; and 

5 ii) evidence derived from said domain related information, 

6 wherein said inference module is configured to make said predictions and recommendations 

7 using partial, incomplete evidence. _ ; ^ — 

1 11. An intelligent computer system as in claim 10 wherein said domain related information 

2 includes substantially static information including historical data related to a set of past 

3 users' sessions and statistical information related to a context of said domain. 

1 12. An intelligent computer system as in claim 10 wherein said domain related information 

2 includes dynamically changing information. 

1 13. An intelligent computer system as in claim 10 wherein said inference module is 

2 configured to passively and continuously conduct collection of said evidence across said 

3 Bayesian model network. 

1 14. An intelligent computer system as in claim 10 wherein said inference module is configured 

2 to convert information related to system events into new evidence in real-timie. 
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1 15. An intelligent computer system as in claim 14 wherein said new evidence is distributed 

2 and propagated to relevant ones of said Bayesian models via a Bayesian model network, 

3 wherein relevant Bayesian models are those Bayesian models having attributes to which 

4 said new evidence pertains. 

1 16. An intelligent computer system as in claim 10 wherein said inference module includes: 

2 A. one or more inference agents configured to gather said evidence and deliver said 

3 predictions and recommendations, wherein said inference agents are inter-linked 

4 according to logical and statistically topological based links by an inference agent 

5 network and further linked to said domain for receiving real-time, event-based 

6 evidence from said domain; and 

7 B. a different set inference engines associated with each of said inference agents, 

8 wherein each of said inference engines is configured to generate and classify said 

9 attribute value predictions by generating probabilistic inference evidence related to 
10 said attribute values. 

1 17. An intelligent computer system as in claim 1 wherein said artificial intelligence module 

2 includes a machiM learning system comprising; 

3 A. an on-line learning module hosted on said application server and configured to 

4 selectively and dynamically update and maintain said Bayesian models in real- 

5 time, as a function of dynamically changing domain related information. 

1 18. An intelligent computer system as in claim 17, said machine learning system further 

2 includes: 

3 B. an off-line learning module configured to dynamically generate and update said 

4 Bayesian models using auto-data mining and as a function of: 

5 a) a unique definition of each entity included in said domain. 

1 19, An intelligent computer system as in claim 18, wherein said off-line learning module is 

2 configured to further dynamically generate and update said Bayesian models as a 
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3 function of: 

4 b) a set of definitions of the relationships between said entities. 

1 20. An intelligent computer system as in claim 1, wherein said system events are related to 

2 interaction of said user with said intelligent computer system. 

1 21. An intelligent computer system as in claim 1, wherein said system events are generated 

2 by a second application linked to said intelligent computer system. 

1 22. An intelligent computer system as in claim 1, wherein said system events are generated 

2 by a second computer system linked to said intelligent computer system. 

1 23. An intelligent con5)uter system as in claim 1, wherein said intelligence application 

2 module includes a rules generation module, configured to facilitate the generation and 

3 storage of said domain related rules. 

1 24. An intelligent e-conunerce computer system for making real-time recommendations and 

2 predictions within the context of an e-commerce domain, said system comprising: 

3 A. at least one application server linked to a first storage media, having a plurality 

4 of Bayesian models stored therein, wherein each Bayesian model represents at 

5 least one product or service entity within said e-commerce domain and includes 

6 one or more entity attributes; 

7 B. at least one Web server disposed between said at least one application server and 

8 a device of said user; 

9 C. an intelligence application module hosted on said application server and 

10 responsive to system events received from said client, said intelligent program 

11 including: 

12 i. a rules generation module, configured to facilitate the generation of 

13 domain related rules and storage of said rules in a rules database; 

14 ii. an artificial intelligence module configured to dynamically update said 

15 Bayesian models as a function of said system events, including an 
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16 inference module hosted on said application server and configured to 

17 generate predictions and recommendations using partial, incomplete 

18 evidence, as a function of: 

19 a) attribute value predictions across all of said Bayesian models over 

20 time; and 

21 b) evidence derived from domain related information; and 

22 iii. a core module configured to evaluate said system events in accordance 

23 with said domain related rules and said Bayesian models and, as a 

24 function thereof, provide predictions and recommendations. 

1 25. An intelligent e-conmierce computer system as in claim 24 wherein said artificial 

2 intelligence module includes a machine learning system comprising: 

3 a. an on-line learning module hosted on said application server and 

4 configured to selectively and dynamically update and maintain said 

5 Bayesian models in real-time, as a function of dynamically changing 

6 domain related information. 

1 26. An intelligent e-conmierce computer system as in claim 25, wherein said machine 

2 learning system further includes: 

3 b. an off-line learning module configured to dynamically generate and 

4 update said Bayesian models using auto-data mining and as a function of: 

5 a) a unique definition of each entity included in said domain. 

1 27. An intelligent e-commerce computer system as in claim 26, wherein said off-line 

2 learning module is configured to further dynamically generate and update said Bayesian 

3 models as a function of: 

4 b) a set of definitions of the relationships between said entities. 

1 28. An intelligent e-commerce computer system as in claim 24, wherein said system events 

2 are related to interaction of said user with said intelligent e-commerce computer system 
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1 29. An inference system, as part of a computer system defining an application domain, wherein 

2 said intelligence computer system is accessible by a plurality of computers via a network, 

3 said inference system comprising: 

4 A. at least one server linked to a storage media; 

5 B. a plurality of Bayesian models, stored in said storage media and representing 

6 specific entities within a context of said domain; and 

7 C. an inference module hosted on said server and configured to generate predictions 

8 and reconunendations as a function of: 

9 i) attribute value predictions across all of said Bayesian models over time, 

10 ii) evidence derived from domain related information; and 

1 1 wherein said inference module is configured to make said predictions and 

12 recommendations using partial, incomplete evidence and said Bayesian models are 

13 logically related to form a Bayesian model network. 

1 30. An inference system as in claim 1 wherein said inference module includes an event-based 

2 asynchronous first channel by which said attribute value observations are provided. 

1 31 . An inference system as in claim 1 wherein said inference module includes a second channel 

2 by which said attribute value predictions are provided. 

1 32. An inference system as in claim 1 wherein said domain inchides a plurality of concepts axid 

2 wherein a concept is represented over one or more of said Bayesian models. 

1 33. An mference system as in claim 4 wherein a concept represented over a plurality of 

2 Bayesian models is represented at different levels of resolution in different ones of said 

3 Bayesian models. 

1 34. An inference system as in claim 5 wherein said domain is an e-commerce domain and one 

2 or more of said concepts represents a product or a service. 

1 35. An inference system as in claim 1 wherein said domain related information includes 
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2 dynamically changing information related to an on-line user's sessions. 

1 36. An inference system as in claim 1 wherein said domain related information includes 

2 dynamically changing information related to said user's interaction with said computer 

3 system. 

1 37. An inference system as in claim 1 wherein said domain related information includes 

2 dynamically changing information related to all on-line users' sessions. 

1 38. An inference system as in claim 1 wherein said domain related information includes 

2 substantially static information. 

1 39. An inference system as in claim 10 wherein said substantially static information includes 

2 historical data related to a set of past users' sessions and statistical information related to 

3 a context of said domain. 

1 40. An inference system as in claim 10 wherein said substantially^tic information includes 

2 user related information, said user related information including indicia of one or more of 

3 the following, said user's: 

4 A. financial information; 

5 B. personal information; 

6 C. history of activity with said computer system; 

7 D. demographic information; and 

8 E. affiliations. 

1 41. An inference system as in claim 1 1 wherein said personal information includes at least one 

2 of the following: 

3 i. age; 

4 ii. gender; 

5 iii. number of children; and 

6 iv. interests. 
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1 42. An inference system as in claim 1 wherein said inference module is configured to passively 

2 and continuously conduct collection of said evidence across said Bayesian model network. 

1 43. An inference system as in claim 1 wherein said inference module is configured to conven 

2 inference system event information into new evidence in real-time. 

1 44. An inference system as in claim 15 wherein said conversion and an accumulation of said 

2 new evidence is accomplished using deterministic and probablistic methods implemented 

3 by said inference module. 

1 45. An inference system as in claim 15 wherein said new evidence is distributed and 

2 propagated to relevant ones of said Bayesian models via said Bayesian model network, 

3 wterein relevant Bayesian models are those Bayesian models having attributes to which 

4 said new evidence pertains. 

1 46. An inference system as in claim 15 wherein said new evidence overrides older evidence 

2 for corresponding attiributes in each of said relevant Bayesian mo(^ 

1 47. An inference system as in claim 1 wherein said inference module includes derived models 

2 configured to monitor system events and derive said evidence from system events detected. 

1 48. An inference system as in claim 19 wherein said inference module iix^hides derived models 

2 configured to monitor system events and derive said evidence fix)m a recognition of system 

3 events not detected. 

1 49. An inference system as in claim 19 wherein the events monitored by said derived models 

2 are related to a user's on-line activity and include one or more of: 

3 A. a category change; 

4 B. a choice of a concept; and 

5 C. a time spent relative to a chosen concept. 

1 50. An inference system as in claim 1 wherein said inference module further includes 
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2 recommending models configured to generate said predictions and reconunendations. 

1 51. An inference system as in claim 1 wherein said inference module includes: 

2 A. one or more inference agents configured to gather said evidence and deliver said 

3 predictions and recommendations, wherein said inference agents are inter-linked 

4 according to logical and statistically topological based links by an inference agent 

5 network and farther linked to said domain for receiving real-time, event-based 

6 evidence from said domain; and 

7 B. a different set inference engines associated with each of said inference agents, 

8 wherein each of said inference engines is configured to generate and classify said 

9 attribute value predictions by generating probabilistic inference evidence related to 
10 said attribute values. 

1 52. An inference system as in claim 23 wherein said attribute value predicitons for a targeted 

2 attribute are made using probability distributions. 

1 53. An inference system as in claim 23 wherein said attribute value predictions for a targeted 

2 attribute are classified using the Maximum Aposteriori Probability algortihm. 

1 54. An inference system as in claim 23 wherein said attribute value predictions for a targeted 

2 attribute are classified using one or more scoring techiniques. 

1 55. An inference system as in claim 23 wherein said scoring techiniques determine one or more 

2 of the following: 

3 A. a relative score; 

4 B. a confidence score; or 

5 C. an omega score. 

1 56. An inference system as in claim 23 wherein said probablistic evidence is involimtarily 

2 dispersed from each inference agent to its peer inference agents, as said probabilistic 

3 evidence is generated. 



93 



wo 00/70481 



PCT/USOO/13360 



1 57. An inference system as in claim 28 wherein said probabilistic evidence is cached. 

1 58. An inference system as in claim 23 wherein each of said inference agents is configured to 

2 selectively request evidence from other inference agents having evidence related to said 

3 prediction request in response to reciept of said prediction request. 

1 59. An inference system as in claim 23 wherein said inference engines are configured to 

2 concurrently generate said probabilistic inference evidence. 

1 60. An inference system as in claim 31 wherein each of said inference engines is configured 

2 to generate said probabilistic inference evidence on a first subset of relevant attributes by 

3 implementing an extended Bucket Elimination process. 

1 61. An inference system as in claim 32 wherein said Bucket Elimination process is extended 

2 to dynamically eliminate a second subset of said relelvant attributes, as a function of the 

3 afiect of said second subset of relevant attributes on the determination of the probablistic 

4 inference evidence. . 

1 62. An inference system as in claim 32, wherein said second subset of relevant attributes are 

2 further eliminated as a function of a tradeoff between a prediction accuracy and a 

3 timeframe available for generating said probablistic inference evidence. 

1 63. An inference system as in claim 23 wherein said inference module further includes an 

2 inference manager configured to selectively associate each of said inference agents with 

3 a specific one of said Bayesian models and further configured to selectively associate at 

4 least one inference engine with each inference agent. 

1 64. An inference system as in claim 23 wherein said inference agents are logically linked 

2 according to a link topology, and wherein links between said inference agents in said 

3 topology represent a statistical relationships between said inference agents. 

1 65. An inference system as in claim 36 wherein said inference module is configured to perform 
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2 agent hopping, wherein a sequence of statistically related inference agents having a 

3 common context are selectively queried for evidence corresponding to a prediction request 

4 to form a sinlge prediction based on the aggregation of evidence from said statistically 

5 related inference agents. 

1 66. An inference system as in claim 37 wherein siaid agent hopping is dynamically controlled 

2 as a function of: 

3 A. the amount of relevant evidence in topology related peer inference agents of a 

4 source inference agent; 

5 B. an information value associated with the relevant evidence of each of said peer 

6 inference agents; 

7 C. a determination that said source inference agent has not previsously hopped to said 

8 destination agent; and 

9 wherein said agent hopping includes a voluntary transfer of evidence from said source 

10 inference agent to a destination peer inference agent and said topology may be traversed 

1 1 upward and downward. 



1 67. An inference system as in claim 23 wherein each of a plurality of inference agents relates 

2 to a different context, but all of said plurality of agents include a conmion attribute, and 

3 said inference module is configured to generate said prediction as a function of a vote 

4 associated with said conmion attribute by each of said plurality of agents. 

1 68. An inference system as in claim 39 wherein said inference module is configured to select 

2 said prediction by determining the most common prediction among said plurality of 

3 inference agents. 

1 69. An inference system as in claim 39 wherein said inference module is configured to select 

2 said prediction by determining the weighted average of a set of predicted probability 

3 distributions over all of said plurality of inference agents and applying the Maximum 

4 Aposteriori Probability algortihm to said weighted average of the predicted probability 

5 distributions. 
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1 70. An inference system as in claim 39 wherein said inference module is configured to select 

2 said prediction by determining the prediction of the most confident inference agent of the 

3 plurality of inference agents. 

1 71. A machine learning system comprising : 

2 A. a processing device linked to a data storage media; 

3 B. an interface to an application system, wherein said interface is configured to 

4 receive domain and entity related information from said application system; 

5 C. a plurality of Bayesian models, stored in said storage media and representing 

6 specific entities within a context of said domain, wherein each Bayesian model 

7 includes one or more attributes; and 

8 D. an on-line learning module hosted on said server and configured to selectively 

9 and dynamically update and maintain said Bayesian models in real-time, as a 

10 function of dynamically changing domain related information, 

1 1 wherein said Bayesian models are used by said computer system to make user-related 

12 recommendations and predictions within a context of said domain. 



1 72. A machine learning system as in claim 1 , wherein one or more of said Bayesian models 

2 are generated manually. 

1 73. A machine learning system as in claim 1 , wherein said on-line learning module is 

2 further configured to update relationships between said Bayesian models. 

1 74. A machine learning system as in claim 1, wherein said Bayesian models are stored in 

2 XML standard format. 

1 75. A machine learning system as in claim 1 , further comprising: 

2 D. an off-line learning module configured to dynamically generate and update said 

3 Bayesian models using auto-data mining and as a function of: 

4 a) a imique definition of each entity included in said domain. 

1 76. A machine learning system as in claim 5, wherein said off-lme learning module is 
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2 configured to further dynamically generate and update said Bayesian models as a 

3 function of: 

4 b) a set of definitions of the relationships between said entities. 

1 77. A machine learning system as in claim 5, wherein said off-line learning module is 

2 further configured to generate links between said Bayesian models as a function of a 

3 statistical relationships between said Bayesian models. 

1 78. A machine learning system as in claim 7, wherein said links are hyperlinks. 

1 79. A machine learning system as in claim 5, wherein each of said Bayesian models 

2 includes a group of attributes, and said attributes are grouped according to domain 

3 related criteria. 

1 80. A machine learning system as in claim S wherein said off-line module is configured to 

2 generate said Bayesian models from a serial stream of data. 

1 81 . A machine learning system comprising: 

2 A. a processing device linked to a data storage media; 

3 B. an interface to an application system, wherein said interface is configured to 

4 receive domain and entity related information from said application system; 

5 C. an off-line learning module executed on said processing device and configured 

6 to dynamically generate and update Bayesian models using auto-data mining as a 

7 function of: 

8 a) a unique definition of each entity included in said domain; and 

9 wherein said Bayesian models are stored in said storage media and represent specific 
10 entities within the context of said domain. 

1 82. A machine learning system as in claim 1 1 wherein said off-line learning module is 

2 configured to fixrther dynamically generate and update Bayesian models as a function 

3 of: 

4 b) a set of definitions of the relationships between said entities. 
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1 83. A machine learning system as in claim 1 1 , wherein said off-line learning module is further 

2 configured to generate links between said Bayesian models as a function of a statistical 

3 relationships between said Bayesian models. 

1 84. A machii^ learning system as in claim 1 1 , wherein each of said Bayesian models includes 

2 a group of attributes, and said attributes are grouped according to domain related criteria. 

1 85. A machine learning system as in claim 11 wherein said off-line module is configured to 

2 generate said Bayesian models from a serial stream of data. 

1 86. A machine learning system as in claim 11, further comprising: 

2 D. an on-lme learning module hosted on said server and configured to selectively and 

3 dynamically update and maintain said Bayesian models in real-time, as a function 

4 of dynamically changing domain related information. 

1 87. A machine learning system as in claim 16, wherein said on-line learning module is further 

2 configured to update relationships between said Bayesian models. 
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AMENDED CLAIMS 

[received by the International Bureau on 16 October 2000 (16.10.00); 
original claims 1-87 replaced by new claims 1-158 (25 pages)] 

1 1 . An intelligent computer system comprising: 

2 A. an application system including an application domain and a plurality of Bayesian 

3 models stored therein, wherein each Bayesian model relates to an entity within 

4 said application domain and includes a set of attributes; 

5 B. at least one application device coupled to said application system; 

6 C. an intelligence system linked to said application system, said intelligence system 

7 including: 

8 1 ) an artificial intelligence module configured to selectively and dynamically 

9 update said Bayesian models as a function of dynamically changing 

10 domain related infonnation; and 

11 2) a core module configured to provide substantially real-time predictions 

12 and reconunendations related to said application domain as a function of 

13 said dynamically changing domain related infonnation. 

1 2. An intelligent computer system as in claim 1 , wherein said Bayesian models are logically 

2 related in a Bayesian model network, 

1 3. An intelligent computer system as in claim 2, wherein said Bayesian models logical 

2 relationships are statistical relationships. 

1 4. An intelligent computer system as in claim 2, wherein said Bayesian models logical 

2 relationships are in the form of hyperlinks. 

1 5. An intelligent computer system as in claim I wherein said Bayesian models are manually 

2 generated. 

1 6. An intelligent computer system as in claim 1 wherein said Bayesian models are 

2 represented m XML format 

1 7. An intelligent computer system as in claim 1 wherein one or more of said entities is 

2 represented over a plurality of said Bayesian models. 
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1 8. An intelligent computer system as in claim 7 wherein an entit}' represented over a 

2 plurality of Bayesian models is represented at different resolution-based context levels. 

1 9. An intelligent computer system as in claim 7 wherein said application domain is an e- 

2 commerce domain and one or more of said entities represents a product, a product 

3 category, a profile, or a service. 

1 10. An intelligent computer system as in claim 1 wherein said artificial intelligence module 

2 includes an inference module configured to generate predictions and recommendations as 

3 a function of: 

4 I ) one or more predicted attribute values of one or more of said Bayesian 

5 models; and 

6 2) evidence derived from said application domain. 

1 11. An intelligent computer system as in claim 10 wherein said evidence derived fi-om said 

2 application domain includes substantially static information. 

1 12. An intelligent computer system as in claim 1 1 wherein said substantially static 

2 information includes one or more of the following: , ' - 

3 A. financial information; 

4 B. personal information; 

5 C. history of activity with said intelligent computer system; 

6 D. demographic information; 

7 E. afiBliations; and 

8 F. externally provided user profile information. 

1 13. An intelligent computer system as in claim 12 wherein said personal information includes 

2 one or more of the following: 

3 1) age; 

4 2) gender, 

5 3) number of children; 

6 4) interests or hobbies; 

7 5) marital status; 

8 6) financial income; and 
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9 7) previous purchases. 

1 14. An intelligent computer system as in claim 1 0 wherein said Bayesian models are related 

2 to form a Bayesian model network and said inference module is configured to passively 

3 and continuously conduct collection of said evidence across said Bayesian model 

4 network. 

1 15. An intelligent computer system as in claim 1 0 wherein said inference module is con- 

2 figured to convert information related to system events into new evidence in real-time. 

1 16. An intelligent computer system as in claim 1 5 wherein said Bayesian models are related 

2 to form a Bayesian model network and one or more of said Bayesian models are 

3 configured to propagate new evidence to relevant other ones of said Bayesian models via 

4 said Bayesian model network, wherein relevant Bayesian models are those Bayesian 

5 models having attributes to which said new evidence pertains. 

1 17. An intelligent computer system as in claim 1 0 wherein said inference module includes: 

2 1 ) one or more inference agents configured to gather said derived evidence 

3 and deliver said predictions and reconunendations,'Whcrein said inference 

4 agents are inter-linked according to logical and statistically topological 

5 based relationships to form an inference agent network and further linked 

6 to said application domain for receiving real-time, event-based derived 

7 evidence fijom said application domain; and 

8 2) a different set of inference engines associated with each of said inference 

9 agents, wherein each of said inference engines is configured to generate 

10 and classify said predicted attribute values by generating probabilistic 

1 1 inference evidence related to said attribute values. 

1 18. An intelligent computer system as in claim 1 wherein said artificial intelligence module 

2 includes a machine learning system comprising: 

3 A. an on-line learning subsystem configured to selectively and dynamically update 

4 and maintain said Bayesian models in real-time, as a function of said dynamically 

5 changing domain related information. 
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1 19. An intelligent computer system as in claim 1 8, wherein said machine learning system 

2 further includes: 

3 B. an off-line learning subsystem, configured to build one or more of said Bayesian 

4 models. 

1 20. An intelligent computer system as in claim 1 9, wherein said off-line learning subsystem 

2 includes an auto-data mining module configured to build and update one or more of said 

3 Bayesian models as a function of: 

4 1) a unique definition of each entity included in said domain; and 

5 2) a set of definitions of the relationships between said entities. 

1 21. An intelligent computer system as in claim 1 , wherein said dynamically changing domain 

2 related information is related to interaction of a user with said intelligent computer system. 

1 22. An intelligent computer system as in claim 1 , wherein said application device includes a 

2 second application and said dynamically changing domain related information is 

3 generated by said second application. 

1 23. An intelligent computer system as in claim 1 , wherein said appliciiition device is a second 

2 computer system and said dynamically changing domain related information is generated 

3 by said second computer system. 

1 24. An intelligent computer system as in claim 1, wherein said intelligence system further 

2 includes: 

3 3) a set of domain related rules, wherein said core module is further 

4 configured to provide said substantially real-time predictions and 

5 recommendations as a further function of said rules. 

1 25. An intelligent computer system as in claim 24, wherein said intelligence system includes 

2 a rules generation module, configured to facilitate the generation and storage of said 

3 rules. 

1 26. An intelligent computer system as in claim 1 , wherein said application device is a wired 

2 or wireless Web-enabled device. 
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1 27. An intelligeni e-commerce computer system comprising: 

2 A. at least one application system including an e-commerce domain and a plurality of 

3 Bayesian models stored therein, wherein one or more of said Bayesian model 

4 represents at least one product, product category, profile or service entity within 

5 said e-commercc domain and includes one or more attributes; 

6 B. at least one Web server coupled between said at least one application system and 

7 at least one user device; 

8 C. an intelligence system coupled to said application system and configured to make 

9 predictions and recommendations related to said e-commerce domain as a 

10 function of a set of domain related rules and system events related to said e- 

1 1 commerce domain. 

1 28. An intelligent e-commerce computer system as in claim 27 wherein said intelligence 

2 system includes: 

3 1 ) an inference system module configured to generate said predictions and 

4 rcconmiendations using partial, incomplete evidence, as a function of: 

5 a) predicted values of attributes made across a plurality of said 

6 Bayesian models over time; and ' 

7 b) evidence derived from said e-commerce domain. 

1 29. An intelligent e-commerce computer system as in claim 24, wherein said intelligence 

2 system includes: 

3 1) a machine learning system including: 

4 a) an on-line learning subsystem configured to selectively and 

5 dynamically update said Bayesian models in real-time, as a 

6 function of dynamically changing domain related information; and 

7 b) an off-line learning subsystem configured to build one or more of 

8 said Bayesian models as a function of at least one of: 

9 i. a unique definition of each entity included in said e- 
10^ commerce domain; and 

11 ii. a set of definitions of the relationships between said 

12 entities. 
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30. An intelligent e-commerce computer system as in claim 27. wherein said intelligence 
system includes a plurality of computer systems, and wherein said intelligence system 
includes: 

1 ) a load distribution module, configured to selectively distribute 

e-commerce domain related processes across said plurality of computer 
systems. 

31. An intelligent e-commerce computer system as in claim 27. wherein said system events 
are related to interaction of said at least one user device with said e-commerce domain. 

32. An intelligent e-commerce computer system as in claim 27, wherein said intelligence 
system includes: 

1) a rules generation module, configured to facilitate the generation and 
maintenance of said domain related rules. 

33. An intelHgent e-commerce computer system as in claim 27, wherein each of said at least 
one user device is a wired or wireless device configured to access the e<ommerce 
domain via the Web. 

. An inference system, interfaced with an application system defming an application 

domain having a plurality of entities represented therein, and accessible by a plurality of 
external devices via a network, said inference system comprising: 

A. at least one processing device linked to a storage media; 

B. a bidirectional interface module coupled to said application system; 

C. a plurality of Bayesian models having a set of attributes, stored in said storage 
media and relating to entities within said appUcation domain; and 

D. an inference module hosted on said processing device and configured to generate 
predictions and recommendations related to said entities as a fiinction of: 

1) one or more predicted attribute values of one or more of said Bayesian 
models, and 

2) evidence derived fit)m said application domain. 

An inference system as in claim 34 wherein said inference module includes an event- 
based asynchronous first channel, by which said evidence is provided for one or more 
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3 atlributes of said Bayesian models. 

1 36. An inference system as in claim 34 wherein said inference module includes a second 

2 channel, by which said predictions and recommendations are provided. 

1 37. An inference system as in claim 34 wherein one or more of said entities is represented 

2 over a plurality of said Bayesian models. 

1 38. An inference system as in claim 37 wherein an entity represented over a plurality of 

2 Bayesian models is represented at different resolution-based context levels. 

1 39. An inference system as in claim 38 wherein said application domain is an e-commerce 

2 domain and one or more of said entities represents a product or a service. 

1 40. An inference system as in claim 34 wherein said evidence derived from said application 

2 domain includes dynamically changing information related to one or more on-line users' 

3 operation of said external devices. 

1 41. An inference system as in claim 34 wherein said inference module is configured to make 

2 said predictions using partial, incomplete evidence. 

1 42. An inference system as in claim 34 wherein said Bayesian models are logically related to 

2 form a Bayesian model network. 

1 43. An inference system as in claim 34 wherein said evidence derived from said application 

2 domain includes substantially static information. 

1 44. An inference system as in claim 43 wherein said substantially static information includes 

2 historical data related to a set of past users' sessions and statistical information related to 

3 said £q)plication domain. 

1 45. An inference system as in claim 43 wherein said substantially static information includes 

2 one or more of the following types of user related information: 

3 A. fmancial information; 
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4 B. personal information; 

5 C. hislorj' of activity with said computer system; 

6 D. demographic information; 

7 E. affiliations; and 

8 F. externally provided user profile information. 

1 46, An inference system as in claim 45 wherein said personal information includes at least 

2 one of the following: 

3 1) age; 

4 2) gender; 

5 3) number of children; 

6 4) interests or hobbies; 

7 5) marital status; 

8 6) financial income; and 

9 7) previous purchases. 

1 47. An inference system as in claim 34 wherein said Bayesian models are logically related to 

2 fom a Bayesian model network and said inference module is configured to passively and 

3 continuously conduct collection of said evidence across said Bayesian model network. 

1 48. An inference system as in claim 34 wherein said inference module is configured to 

2 convert inference system event information into new evidence in real-time. 

1 49. An inference system as in claim 48 wherein said conversion and an accumulation of said 

2 new evidence is accomplished using deterministic and probabilistic methods 

3 implemented by said inference module. 

1 50. An inference system as in claim 48 wherein said Bayesian models are logically related to 

2 form a Bayesian model network and one or more of said Bayesian models are configured 

3 to propogate said new evidence to relevant other ones of said Bayesian models via said 

4 Bayesian model network, wherein relevant Bayesian models are those Bayesian models 

5 having attributes to which said new evidence pertains. 

1 51 . An inference system as in claim 48 wherein said new evidence overrides older evidence 
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2 for corresponding attributes in relevant ones of said Bayesian models. 

1 52. An inference system as in claim 34 wherein said inference module includes derived 

2 models configured to monitor system events and derive said evidence from system events 

3 detected. 

1 53. An inference system as in claim 52 wherein said inference module includes derived 

2 models configured to monitor system events and derive said evidence from a recognition 

3 of system events not detected. 

1 54. An inference system as in claim 52 wherein the events monitored by said derived models 

2 are related to a user's on-line activit\' via one of said external devices, and said events 

3 include one or more of: 

4 A. a category change; 

5 B. a choice of an entity; and 

6 C. a time spent relative to a chosen entity; 

7 D. a user's session start or end time; 

8 E. a page view change; 

9 F. adding or removing a product from a shopping cart; or 

10 G. a content and a size of the shopping cart; 

11 H. a product purchase. 

1 55. An inference system as in claim 34 wherein said inference module is configured to 

2 generate said predictions and recommendations using at least one reconunendation query 

3 technique chosen from a group of techniques including: 

4 A. deep recommend; 

5 B. var reconmiend; 

6 C. shallow recommend; and 

7 D. active evidence recommend. 

1 56. An inference system as in claim 34 wherein said inference module includes: 

2 1) one or more inference agents configured to gather said derived evidence 

3 and deliver said predictions and recommendations, wherein said inference 

4 agents are inter-linked according to logical and statistically topological 
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5 based relationships lo form an inference agent network and further linked 

6 lo said domain for receiving real-lime, event-based derived evidence from 

7 said domain; and 

8 2) a different set inference engines associated with each of said inference 

9 agents, wherein each of said inference engines is configured to generate 

10 and classify said predicted attributes value by generating probabilistic 

1 1 inference evidence related to said attribute values. 

1 57. An inference system as in claim 56 wherein said attribute value predictions for a targeted 

2 attribute are made using probability distributions. 

1 58. An inference system as in claim 56 wherein said attribute value predictions for a targeted 

2 attribute are classified using the Maximum Aposteriori Probability algorithm. 

1 59. An inference system as in clgdm 56 wherein said attribute value predictions for a targeted 

2 attribute are classified using one or more scoring techniques. 

1 60. An inference system as in claim 59 wherein said scoring techniques determine one or 

2 more of the following: 

3 A. a relative score; 

4 B. a confidence score; or 

5 C. an omega score. 

1 61. An inference system as in claim 56 wherein said probabilistic evidence is involuntarily 

2 dispersed fix)m each inference agent to its peer inference agents, as said probabilistic 

3 evidence is generated. 

1 62. An inference system as in claim 61 wherein said probabilistic evidence is cached. 

1 63. An inference system as in claim 56 wherein each of said inference agents is configured to 

2 selectively request evidence firom other inference agents having evidence related to said 

3 prediction request in response to receipt of said prediction request 

1 64. An inference system as in claim 56 wherein said inference engines are configured to 
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2 concurrently generate said probabilistic inference evidence. 

1 65. An inference system as in claim 64 wherein each of said inference engines is configured 

2 to generate said probabilistic inference evidence on a first subset of relevant attributes by 

3 implementing an extended Bucket Elimination process, wherein said relevant attributes 

4 are those attributes useful in the generation of said probabilistic inference evidence. 

1 66. An inference system as in claim 65 wherein said Bucket Elimination process is extended 

2 to dynamically eliminate a second subset of said relevant attributes, as a function of the 

3 affect of said second subset of relevant attributes on the determination of the probabilistic 

4 inference evidence. 

1 67. An inference system as in claim 66, wherein said Bucket Elimination process is extended 

2 to determine said first subset of rele\'ant attributes as a function of a tradeoff between a 

3 desired prediction accuracy and a timefi^me available for generating said probabilistic 

4 inference evidence, wherein said second subset of relevant attributes includes those 

5 relevant attributes not included in said first set of relevant attributes. 



1 68. An inference system as in claim 56 wherein said inference module fiirther includes an 

2 inference manager configured to selectively associate each of said inference agents with a 

3 specific one of said Bayesian models and fiirther configured to selectively associate at 

4 least one inference engine with each inference agent. 

1 69. An inference system as in claim 56 wherein said inference agents are logically linked 

2 according to a link topology, and wherein links between said inference agents in said 

3 topology represent a statistical relationships between said inference agents. 

1 70. An inference system as in claim 69 wherein said inference module is configured to 

2 perform agent hopping, wherein a sequence of statistically related inference agents 

3 having a common context are selectively queried for evidence corresponding to a 

4 prediction request to form a single prediction based on the aggregation of evidence from 

5 said statistically related inference agents. 

1 71. An inference system as in claim 70 wherein said agent hopping is dynamically controlled 
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2 as a function of: 

3 A. the amount of relevant evidence in lopologically related peer inference agents of a 

4 source inference agent; 

5 B. an information value associated with the relevant evidence of each of said peer 

6 inference agents; and 

7 C. a determination that said source inference agent has not pre\ iously hopped to said 

8 destination agent, 

9 wherein said agent hopping includes a voluntar>' transfer of evidence from said source 

10 inference agent to a destination peer inference agent and said topology may be traversed 

1 1 upward and do ward. 

1 72. An inference system as in claim 56 wherein each of a plurality of inference agents relates 

2 to a different context and share a common attribute, and said inference module is 

3 configured to generate said prediction as a function of a vote associated writh said 

4 conmion attribute by each of said plurality of agents. 

1 73. An inference system as in claim 72 wherein said inference module is configured to select 

2 said prediction by determining the most common prediction aniong s^d plurality of 

3 inference agents. 

1 74. An inference system as in claim 72 wherein said inference module is configured to select 

2 said prediction by determining the weighted average of a set of predicted probability 

3 distributions over all of said plurality of inference agents and applying the Maximum 

4 Aposteriori Probability algorithm to said weighted average of the set of predicted 

5 probability distributions. 

1 75. An inference system as in claim 72 wherein said inference module is configured to select 

2 said prediction by determining the prediction of the most confident inference agent of the 

3 plurality of inference agents. 

1 76. An inference system as in claim 56 wherein said inference module is configured to 

2 generate said predictions and recommendations using at least one recommendation query 

3 technique, chosen from a group of techniques including: 

4 A. deep recommend; 
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5 B. var recommend: 

6 C. shallow recommend; 

7 D. active evidence recommend 

8 E. agent hop; and 

9 F. agent vote. 

1 77. A method of providing predictions and reconmiendations, related to entities represented 

2 within an application domain of an application system that is accessible by a plurality of 

3 external devices via a network, by an inference system coupled to said application system 

4 and including a processing device and storage media having a plurality of Bayesian 

5 models related to said entities stored therein, said method comprising: 

6 A. accessing relevant Bayesian models from said storage media; 

7 B. predicting attribute values for said Bayesian models; 

8 C. deriving evidence from said application domain; and 

9 D. generating a prediction or recommendation as a function of said Bayesian models 
1 0 and said derived evidence. 

1 78. The method of claim 77 wherein one or more of said entities is,repr<?sented over a 

2 plurality of said Bayesian models. 

1 79. The method of claim 77 wherein said application domain is an e-commerce domain and 

2 each of said entities represents a product or a service. 

1 80. The method of claun 77 wherein step C includes monitoring system events and deriving 

2 evidence from events observed, 

1 81 ■ The method of claim 80 wherein said events monitored are related to a user's on-line 

2 activity via one of said external devices, and said events include one or more of: 

3 1) a category change; 

4 2) a choice of a context; 

5 3) a time spent relative to a chosen entity, 

6 4) a user's session start or end time; 

7 5) a page view change; 

8 6) adding or removing a product from a shopping cart; 
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9 7) a content and a size of the shopping cart; and 

10 8) a product purchase. 

1 82. The method of claim 77 wherein step C includes monitoring system events and deriving 

2 evidence from a recognition of events not observed. 

1 83. The method of claim 77 wherein said evidence derived from said application domain in 

2 step C includes substantially static information. 

1 84. The method of claim 83 wherein said substantially static information includes historical 

2 data related to a plurality of past users' interaction with said application system. 

1 85. The method of claim 83 wherein said substantially static information includes 

2 information related to a current user. 

1 86. The method of claim 77 wherein steps B and C are carried out passively and 

2 continuously. 



1 87. The method of claim 77 wherein step B includes the step of: 

2 1) generating probablistic inference evidence on a first subset of relevant 

3 attributes by implementing an extended Bucket Elimination process, 

4 wherein said relevant attributes are those attributes useful in the generation of said 

5 probabilistic inference evidence. 

1 88. The method of claim 87 wherein step B further includes, as an extension to said Bucket 

2 Elimination process: 

3 2) eliminating a second subset of attributes as a fimction of the affect of said 

4 second set of attributes on the generation of the probablistic inference 

5 evidence on said first set of attributes. 

1 89. The method of claim 88 wherein said extension to said Bucket Elimination process 

2 includes perfoimmg a tradeoff analysis between a desired prediction accuracy and a 

3 timefiame to generate said probabilistic inference to determine said first set of relevant 

4 attributes necessary to achieve said prediction accuracy in said timeframe, wherein said 
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5 second subset of relevant attributes includes those relevant attributes not included in said 

6 first set of relevant attributes. 

1 90. The method of claim 77, v/herein said inference system includes a plurality of inference 

2 agents under the control of one or more inference managers, and steps A through D are 

3 carried out by said inference agents, wherein at least one inference agent is associated 

4 with each of said Bayesian models. 

5 91 . The method of claim 90 wherein said inference agents facilitate the sharing of said 

6 evidence among said Bayesian models. 

1 92. The method of claim 77 wherein said in Step D includes generating said predictions and 

2 recommendations using at least one recommendation quer\' techniques from a group of 

3 techniques including: 

4 1) deep recommend; 

5 2) var recommend; 

6 3) shallow recommend; 

7 4) active evidence recommend _ „, . _ 

8 5) agent hop; and 

9 6) agent vote. 

1 93. A machine learning system comprising: 

2 A. at least one processing device linked to a data storage media; 

3 B. an interface to an application sj'stem defining an application domain, wherein said 

4 interfece is configured to receive dynamically changing domain related 

5 information fitim said application system; 

6 C. a plurality of Bayesian models having a set of attributes, stored in said storage 

7 media and relating to entities within said application domain; and 

8 D. an on-line learning subsystem hosted on said at least one processing device and 

9 configured to selectively and dynamically update said Bayesian models in real- 
10 time, as a function of said dynamically changing domain related information. 

1 94. A machine learning system as in claim 93, wherein said on-line learning system is further 

2 configured to update said Bayesian models as a function of substantially static 

113 



AMENDED SHEET (ARTICLE 19) 



1 



wo 00/70481 PCTAJSOO/13360 

3 information, including indicia of one or more of the following: 

4 A. historical application domain related data; 

5 B. financial information; 

6 C. personal information; 

7 D. user history of activity with said application system; 

8 E. demographic information; 

9 F. affiliations; and 

10 G. externally provided user profile information. 

1 95. A machine learning system as in claim 93, wherein said at least one processing device 

2 includes a plurality of processing devices, and wherein said machine learning system 

3 further includes: 

4 E. a load distribution module, configured to selectively distribute processes related 

5 to said updating of said Bayesian models across said plurality of processing 

6 devices as a function of a processing load of each of said processing devices. 

1 96. A machine learning system as in claim 93, wherein said Bayesian models are stored in 

2 XML standard format. ^ 

1 97. A machine learning system as in claim 93, wherein said Bayesian models are part of a 

2 Bayesian model network and linked by inter-model links, and said on-line learning 

3 subsystem includes an on-line learning module configured to create, update and delete 

4 said inter-model links. 

1 98. A machine learning system as in claim 97, wherein each of said inter-model links 

2 corresponds to a statistical relationship between two linked Bayesian models and said 

3 on-line learning module is configured to update said inter-model links as a fimction of 

4 said dynamically changing domain related information. 

1 99. A machine learning system as in claim 97 wherein said Bayesian model network 

2 represents a joint probability distribution across all attributes of said plurality of Bayesian 

3 models. 

1 100. A machine learning system as in claim 93, wherein one or more of said Bayesian models 
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2 includes a model structure defined by said attributes and a set of intra-model links, 

3 wherein for a given Bayesian model a set of intra-model links establishes relationships 

4 between two or more attributes of said given Bayesian model. 

1 101 . A machine learning system as in claim 100, wherein said on-line learning subsystem is 

2 configured to create, update and delete said intra-model links. 

1 102. A machine learning system as in claim 100 wherein said intra-model links represent joint 

2 probabilities of at least two attributes, and wherein said updating includes updating said 

3 joint probabilities. 

1 103. A machine learning system as in claim 93 wherein said on-line learning subsystem 

2 includes a plurality of learning agents and each of said learning agents is associated with 

3 and configured to update a corresponding one or more of said Bayesian models. 

1 104. A machine learning system as in claim 93, wherein said plurality of Bayesian models are 

2 part of a Bayesian model network and said on-line learning subsystem includes a 

3 plurality of learning agents and each of said learning agents is configured to transfer 

4 information between two or more of said plurality of Bayesian models via the Bayesian 

5 model network. 

1 105. A machine learning system as in claim 93 further comprising: 

2 E. an interface to an inference system, wherein said inference system is configured 

3 to generate reconmiendations and predictions related to said Bayesian models. 

1 106. A machine learning system as in claim 105 wherein said on-line learning subsystem is 

2 configured to query said inference system to obtain said recommendations and 

3 predictions. 

1 107. A machine learning system as in claim 1 05 wherein one or more of said Bayesian models 

2 is updated in response to information received from said inference system. 

1 108. A machine learning system as in claim 93 wherein said on-line learning subsystem is 

2 configured to update said Bayesian models using partial and incomplete sets of attribute 
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values, wherein one or more of said Bayesian models includes a subset of attributes 
having undefined attribute values. 

learning system as in claim 93 wherein said on-line subsystem includes one or 

a polling module, configured to poll said application domain for said 
dynamically changing domain related information; and 
a notification recei\ er module, configured to receive notifications fi-om 
said application domain related to said dynamically changing domain 
related information. 

110. A machine learning system as in claim 93, fiirther comprising: 
E. an off-line subsystem including: 

1) an off-line building module, configured to generate one or more of said 
Bayesian models, wherein each of said Bayesian models includes a set of 
attributes; and 

2) an off-line learning module, configured to learn said one or more Bayesian 
models, wherein each learned Bayesian model includes determined 
attribute values for said set of attributes. 

11. A machine learning system as in claim 1 1 0, wherein said off-line building module 
includes an auto-data mining module configured to build said one or more Bayesian 
models as a function of one or more of: 

1) a unique definition of each of said entities; 

2) a set of data cases, each of said data cases including information relating a 
group of said entities; and 

3) a set of definitions of the relationships between said entities. 

12. A machine learning system as in claim 93, wherein said dynamically changing domain 
related information is related to an event generated by an application hosted on or 
accessible by said application system. 

13. A machine learning system as in claim 93, wherein said dynamically changing domain 
related information is related to a user's interaction with said application system via a 
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3 wired or wireless device linked to said application system. 

1 114. A machine learning system as in claim 93. wherein said application system is a Web- 

2 based application system and said dynamically changing domain related information is a 

3 function of a user's interaction with a said Web-based application system. 

1 115. A machine learning system as in claim 93. wherein said application domain is an c- 

2 commerce domain and one or more of said entities represents a product, service, or 

3 product category. 

1 116. A machine learning system comprising: 

2 A. at least one processing device linked to a data storage media; and 

3 B. an off-line learning subsystem hosted on said at least one processing device and 

4 including: 

5 1) an off-line building module, configured to generate and store in said 

6 storage media one or more Bayesian models, wherein each of said 

7 Bayesian models is configured to represent at least one entity related to an 

8 application domain of an application system and each of said Bayesian 

9 models includes a set of attributes. 

1 117. A machine learning system as in claim 1 1 6, wherein said off-line building module further 

2 includes: 

3 2) an off-line learning module, configtired to learn said one or more Bayesian 

4 models, wherein each learned Bayesian model includes determined 

5 attribute values for said set of attributes. 

1 118. A machine learning system as in claim 116, wherein said off-line building module 

2 includes an auto-data mining module configured to build said one or more Bayesian 

3 models as a function of one or more of: 

4 1) a unique definition of each of said entities; and 

5 2) a set of data cases, each of said data cases including information relating a 

6 group of said entities. 

1 1 19. A machine learning system as in claim 1 1 8, wherein said off-line building module is 
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2 configured to further generate Bayesian models as a function of: 

3 3) a set of definitions of the relationships between said entities. 

1 120. A machine learning system as in claim 116. wherein said Bayesian models are structured 

2 to be used to make recommendations and predictions within said application domain. 

1 121 . A machine learning system as in claim 1 1 6, wherein said off-line learning subsystem is 

2 fiirther configured to generate a Bayesian model network comprising said Bayesian 

3 models and a plurality of corresponding inter-model links. 

1 122. A machine learning system as in claim 121, wherein each inter-model link relates to a 

2 pair of Bayesian models and is generated as a function of one or more statistical 

3 relationships between entities represented by said pair of Bayesian models. 

1 123. A machine learning system as in claim 121 wherein said Bayesian model network 

2 represents a joint probability distribution across all attributes of said plurality of Bayesian 

3 models. 

1 124. A machine learning system as in claim 1 1 6, wherein siaid attributes are grouped according 

2 to one or more application domain related criterion. 

1 125. A machine leaning system as in claim 1 16, wherein one or more of said Bayesian 

2 models includes a model structure defined by said attributes and intra-model links, 

3 wdierein for a given Bayesian model a set of intra-model links establish relationships 

4 between two or more attributes of said given Bayesian model. 

1 126. A machine learning system as in claim 125 wherein said intra-model links represent joint 

2 probabilities of at least two attributes. 

1 127. A machine learning system as in claim 1 1 6, wherein said off-line subsystem fiuther 

2 comi^ises: 

3 2) a manual Bayesian model generator, configured to generate and store one 

4 or more of said Bayesian models in response to a user's instructions. 
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1 128. A machine learning system as in claim 1 16, further comprising: 

2 C. an interface to said application system, wherein said interface is configured to 

3 receive dynamically changing domain related information from said application 

4 system; and 

5 D. an on-line learning subsystem hosted on said at least one processing device and 

6 configured to selectively and dynamically update said Bayesian models in real- 

7 time, as a function of said dynamically changing domain related information. 

1 129. A machine learning system as in claim 128, wherein said on-line learning subsystem is 

2 configured to update relationships between said Bayesian models. 

1 130. A machine learning system as in claim 128, wherein said plurality of Bayesian models 

2 are part of a Bayesian model network and said on-line learning subsystem is configured 

3 to transfer information between two or more of said plurality of Bayesian models via the 

4 Bayesian model network. 

1 131. A machine learning system as in claim 1 1 6, further configured to generate, learn, and 

2 iqxlate said Bayesian models as a function of substantially static information, including 

3 indicia of one or more of the following: 

4 A. historical application domain related data; 

5 B. financial information; 

6 C. personal information; 

7 D. user history of activity with said application system; 

8 E. demographic information; 

9 F. affiliations; and 

10 G. externally provided user profile information. 

1 132. A machine learning system as in claim 1 1 6, wherein said application domain is an e- 

2 commerce domain and one or more of said entities represents a product, service, or 

3 product category. 

1 133. A machine learning system comprising: 

2 A. at least one processing device linked to a data storage media; 

3 B. an interface to an application system defining an application domain, wherein said 
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4 interface is configured to receive dynamically changing domain related 

5 information from said application system; 

6 C. a plurality of Bayesian models having a set of attributes, stored in said storage 

7 media and relating to entities within said application domain; 

8 D. an off-line subsystem configured to generate and leam one or more of said 

9 Bayesian models; and 

10 E. an on-line learning subsystem hosted on said at least one processing device and 

1 1 configured to selectively and dynamically update said Bayesian models in real- 

12 time, as a function of said dynamically changing domain related information. 

1 134, A machine learning system as in claim 133, fiirther comprising: 

2 F. an interface to an inference system, wherein said inference system is configured 

3 to generate reconmiendations and predictions related to said Bayesian models. 

1 1 35. A machine learning system as in claim 1 33, wherein said application domain is an e- 

2 commerce domain, said application system is accessible by constmiers via the Web, and 

3 one or more of said entities represents a product, service, or product category. 

1 136. A machine learning system as in claim 1 33, wherein said dynamically changing domain 

2 related information is related to a user's interaction with said application system via a 

3 wired or wireless device linked to said application system. 

1 137. A machine learning system as in claim 133, wherein each entity represents a product or 

2 service available via said application system and said dynamically changing domain 

3 related information includes infonnation related to one or more consumers* interaction 

4 with said application system. 

1 138. A machine learning system as in claim 1 33, fiirther configured to generate, leam, and 

2 update said Bayesian models as a fimction of substantially static information, including 

3 indicia of one or more of the following: 

4 A. historical application domain related data; 

5 B. financial information; 

6 C. persona] information; 

7 D. user history of activity with said application system; 
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8 E. demographic information; 

9 F. affiliations; and 

10 G. externally provided user profile information. 

1 139. A machine learning system as in claim 133, wherein one or more of said Bayesian 

2 models includes an model structure defined by said attributes and intra-model links, 

3 wherein for a given Bayesian model a set of intra-model links establishes relationships 

4 between two or more attributes of said given Bayesian model. 

1 140. A machine learning system as in claim 1 38, wherein said on-line learning subsystem is 

2 configured to create, update and delete said intra-model links. 

1 141. A machine learning system as in claim 1 39 wherein said intra-model links represent joint 

2 probabilities of at least two attributes, and wherein said updating includes updating said 

3 joint probabilities. 

1 142. A noachine learning system as in claim 133, wherein said pluralitj' of Bayesian models 

2 are linked by inter-model links as part of a Bayesian model network, and said on-line 

3 learning subsystem is configured to transfer information between two or more of said 

4 plurality of Bayesian models via the Bayesian model network. 

1 143. A method of representing and maintaining entities in an application domain of an 

2 application system, wherein said application system is linked to a learning system having 

3 a processing device and a storage media, said method comprising: 

4 A. generating a plurality of Bayesian models representing said entities, wherein each 

5 of said Bayesian models includes a set of attributes corresponding to at least one 

6 of said entities; 

7 B. producing a Bayesian model network comprised of said Bayesian models and 

8 inter-model links, wherein one or more of said inter-model links are generated 

9 between a pair of said Bayesian models as a fimction of one or more statistical 

10 relationships between entities represented by said pair of Bayesian models; and 

1 1 C. updating said Bayesian models and said Bayesian model network as a fimction of 

12 dynamically changing domain related information. 
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1 144. The method of claim 143, wherein said Bayesian models are funher updated as a function 

2 of substantially static information. 

1 145. The method of claim 144 wherein said substantially static information includes indicia of 

2 one or more of the following: 

3 A. historical application domain related data; 

4 B. financial information; 

5 C. personal information; 

6 D. user history of activity with said application system; 

7 E. demographic information; 

8 F. affiliations; and 

9 G. externally provided user profile information. 

1 146. The method of claim 143 further comprising: 

2 D. interfacing with an inference system configured to generate predictions and 

3 recommendations related to said Bayesian models. 

1 147. The method of claim 143 wherein, for at least one of said entities, step A is accomplished 

2 using a partial and incomplete set of attribute values, wherein a siibset of attribute values 

3 are undefined. 

1 148. The method of claim 147 wherein step A includes: 

2 1 ) obtaining recommendations and estimations for said undefined attribute 

3 values firom an inference system configured to generate predictions and 

4 recommendations. 

1 149. The method of claim 143 wherein steps A and B are accomplished using auto-data 

2 mining and as a function of: 

3 1) a unique definition of each entity included in said domain; and 

4 2) a set of data cases, each of said data cases comprising a group of entities in 

5 said domain. 

1 150. The method of claim 1 49 wherein steps A and B are accomplished as a further function 

2 of: 
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3 3) a set of definitions of the relationships between said entities. 

1 151. The method of claim 1 43 wherein said updating in step C is carried out by learning 

2 agents, wherein each learning agent is associated with at least one of said Bayesian 

3 models. 

1 152. The method of claim 143, wherein Step A includes defining a model structure by 

2 establishing a set of intra-model links between said attributes, wherein for a given 

3 Bayesian model a set of intra-model links establishes relationships between two or more 

4 attributes of said given Bayesian model. 

1 153. The method of claim 151, wherein Step D includes creating, updating and deleting said 

2 intra-model links. 

1 154. The method of claim 1 52, wherein said intra-model links represent joint probabilities of 

2 at least two attributes, and wherein said updating includes updating said joint 

3 probabilities. 

1 155. The method of claim 143, wherein at least one of steps A, B, and C includes transferring 

2 information between two or more of said plurality of Bayesian models via the Bayesian 

3 model network. 

1 156. The method of claim 143 wherein said context is an e-commerce context and each of said 

2 entities represents a product, service, or product category. 

1 157. The method of claim 143 further comprising: 

2 D. accessing said application domain via the Web. 

1 158. The method of claim 143 further comprising: 

2 D, accessing said application domain via a wired or wireless device. 
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600 

'Ar/BAK';BAKBAG\'100336'.'Fresh\'Bakery';Fresh Baked Bagels'.'Back Bay Bagels - Garlic' 
'Ar;BAK\'BAKBAG';i0033r;Fresh';Bakery';Fresh Baked Bagels'/Back Bay Bagels - Honey 

Grain' 

'Ar.'BAK\'BAKBAG';i00338'.'Fresh'/Bakery'.'Fresh Baked Bagels\'Back Bay Bagels - Salf 

'A1'.'BAK\'BAKBAG';i00339';Fresh'.'Bakefy'.'Fresh Baked Bagels'.'Back Bay Bagels - Rye' 
'Ar.'BAK';BAKBAG\'100340\'Fresh'.'Bakerv'.'Fresh Baked Bagels'/Back Bay Bagels ■ Marble' 
'AV.'BAK';BAKBAG\'100341';Fresh';Bakery';Fresh Baked Bagels'/Back Bay Bagels - Poppy' 
•Ar;BAK'/BAKBAG';i00342'/Fresh';Bakery '/Fresh Baked Bagels'/Back Bay Bagels - 

Pumpemk:ker 

'Ar;BAK'.'BAKBAG'.'100343'/Fresh';Bakery\'Fresh Baked Bagels'/New York Bagel Chips Gariic' 
'Ar.'BAK','BAKBAG';i00344'.'Fresh';Bakery'.'Fresh Baked Bagels','New York Bagel Chips Plain 

Low Salf 

•Ar/BAK';BAKBAG'/100345\'Fresh'/Bakery';Fresh Baked Bagels'.'New York Bagel Chips 

Cinnamon Raisin' 

'Ar;BAK','BAKBAG';i00346\'Fresh';Bakery';Fresh Baked Bagels'/New York Bagel Chips Garlic 

98% Fat Free' 

'A1\'BAK';BAKBAG';i00347','Fresh';Bakery';Fresh Baked Bagels'.'Back Bay Bagels - Everything' " 
'A1','BAK'.'BAKBAG';iOQ348';Fresh'.'Bakery'.'Fresh Baked Bagels'/Back Bay Bagels - Bluet?erTy' 
'Ar;BAK*;BAKBAG'.'100349';Fresh'.'Bakery';Fresh Baked Bagels'/Boston Bagel Plain 20 oz' 
'A1'/BAIC/BAKBAG\'100350'.'Fresh'/Bakery'.'Ffesh Baked Bagels'.'Boston Bagel Onion 20 ot 
'Ar;BA)C;BAKBAG';i0035r;Fresh'.'Bakery';Fresh Baked Bagels'/Boston Bagel Sesame 20 oz' 
'Ar/BAIC/BAKBAG'/IOOSSZ/Fresh'.'Bakery'/Fresh Baked Bagels'/Boston Bagel Honey Wheat 20 

QZ' 

*A1 '/BAK'.'BAKBAG','1 Q0353'.'Fresh';Bakery';Fresh Baked Bagels'/Boston B^gel Marble 20 oz' ' 
*Ar,'BAK*;BAKBAG';i00354';Fresh','Bakery\'Fresh Baked Bagels'.'Boston Bagel Cinnamon 

Raisin 20 oz' 

'Ar/BAK';BAKBAG'.'100355';Fresh','Bakefy'.'Fresh Baked Bagels'/New York Pita Chips Plain' ' " 
'Ar;BA}C;BAKBAG','100356'.'Fresh';Bakery';Fresh Baked Bagels'.'New York Pita Chips Garlic' 
'Ar/BAIC/BAKBAG'.'IOQSSy'/Fresh'/Bakery'/Fresh Baked Bagels'.'Back Bay Bagels - Sourdough'" 
'Ar/BAIC,'BAKBRD'.'100366\'Fresh';Bakery'.'Fresh Baked Breads'/Fresh Bread - Scala' '■ 
'AV.'BAlC.'BAKBRD'.'IOOSSr.'Fresh'.'Bakefy'/Fresh Baked Breads'.'Fresh Bread - Italian Sliced' 
'Ar/BAfC.'BAKBRD'/IOOSSS'.'Fresh'.'Sakery'.'Fresh Baked Breads'. 'Fresh Bread - Italian Unslk»l' 
'Ar.'BAIC;BAKBRD*.'100369','Fresh';Bakery';Fresh Baked Breads'/Fresh Bread - Pumpkin Raisin 

Sliced' 

'Ar/BAIC.'BAKBRD'.'IOOSrO'.'Fresh'.'Bakery'.'Fresh Baked Breads'.'Fresh Bread - French 
Baguette' 

•Ar,'BAK','BAKBRD'/10037r,'Fresh';Bakery'.'Fresh Baked Breads'.'Fresh Bread - Luceme Mutti 
Grain Slk:ed' 

'Ar/BAK'.'BAKBRD'.'100372';Fresh' 'Bakery'.'Fresh Baked Breads'.'Fresh Bread - Chaliah' 
'A1'/BAK'.'BAKBRD'.'100373'.'Fresh';Bakery'.'Fresh Baked Breads'.'Fresh Bread - Rye Crusty' 
'Ar;BAK','BAKBRD','100374'/Fre$h ;Bakery';Fresh Baked Breads'.'Fresh Bread - Batard' 
'Ar,'BAK';BAKBRD';i00375','Fresh'.'Bakery'.'Fresh Baked Breads'.'Fresh Bread - Sour Dough' 
'A1'.'BAK'.'BAKBRD'.'100376'.'Fresh'.'Bakery'.'Fresh Baked Breads'.'Fresh Bread - Mountain White' 
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< HYPER LINKS > 




<HYPER~LINK MODELl = "A0.A0B9'' M0DEL2 = 


"A7" 


COUPLING= "0.7334138956943544" > 




<SHVARS VAR="A0.A0B9"/> 




<SHVARS VAR="A7.A7B5"/> 




</HYPER_LINK> 




<HYPER_LINK MODELl = "A5.A5B6" M0DEL2= 
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COUPLING= "0.7747616246161703" > 




<SHVARS VAR= "A5.A5B6"/> 




< SHVARS VAR= "A7. A7B8"/ > 




</HYPER LINK> 
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